source("./read_from_db.R")

This is a first pass exploration of different aspects of beer. The data was collected via the BreweryDB API. Special thanks to Kris Kroski for data ideation and co-membership in the honourable workplace beer consortium.

The main question this analysis is meant to tackle is: Are beer styles actually indicative of shared attributes of the beers within that style? Or are style boundaries more or less arbitrary? I took two approaches to this: unsupervised clustering and supervised prediction.

Clusters defined by the algorithm were compared to the style “centers” as defined by the mean ABV, IBU, and SRM. On the prediction side, predictor variables for include ABV (alcohol by volume), IBU (international bitterness units), SRM (a measure of color) as well as ingredients like hops and malts. The outcome variable is the style that beer was assigned.

This document starts off with an explanation of how I sourced beer data from BreweryDB, cleaned that data, and stuck the parts of it I wanted in a database. (These are just the highlights; the code actually executed in this document queries that database, specifically by sourcing the file read_from_db.R, also in this repo, rather than hitting the BreweryDB API. This is done for expediency’s sake as the code below detailing how to actually get the beer data, run in full in run_it.R, takes some time to execute.)

It then moves into clustering (k-means) and prediction (neural net, random forest).

The answer thus far seems to be that the beer landscape is more of a spectrum than a collection of neatly differentiated styles. Beer-intrinsic attributes like bitterness aren’t great predictors of style. The relative importance of different variables depeends on the prediction method used. However, one style-defined attribute, the glass a beer is served in, increased the accuracy of prediction substantially.

Of course, other important aspects of the flavor, body, smell, etc. of the beers could not be considered because this data is not available from BreweryDB.

Workflow Overview

Get and Prepare

When we first hit the BreweryDB API to iteratively pull in all beers and their ingredients along with other things we might want like breweries and glassware. Then we unnest the JSON responses, including all the ingredients columns, and dump this all into a MySQL database.

Next, we create a style_collapsed column to reduce the number of levels of our outcome variable. We do this by greping through each beer’s style to determine if that style contains a keyword that qualifies it to be rolled into a collapsed style; if it does, it gets that keyword in a style_collapsed column.

Finally we unnest the ingredients hops and malts into a wide, sparse dataframe. Individual ingredients are now columns, with each beer still in its own rows; a cell gets a 1 if ingredient is present and 0 otherwise. This allows more granual inference into ingredients’ effects on both style and bitterness (occasioning a short foray into hops).

Short foray into hops

A quick look at the most popular hops and an exploration of the relationship between hops and bitterness.

Infer

Cluster: unsupervised k-means clustering partitioning the entire dataset into ten clusters. Next, we cluster on a dataset composed of just five selected styles into five clusters.

We then attempt to predict predict either style or style_collapsed using a neural net and a random forest. The main predictors are ABV, IBU, SRM, total number of hops, and total number of malts. The glass a beer is served in is also considered. Finally,


Short Aside

The question of what should be a predictor variable for style is a bit murky here. What should be fair game for predicting style and what shouldn’t? Characteristics of a beer that are defined by its style would seem to be “cheating” in a way. The only “inputs” to a beer we have in our dataset are its ingredients, primarly hops and malts. While these certainly have an effect on its flavor profile, I consider them semi-cheating because if style is determined beforehand it likely determines at least in part which ingredients are added. The main candidates in my mind are ABV, IBU, and SRM. These are “outputs” of a beer (in the sense that they can only be exactly determined once a beer is brewered) that meaningfully define it. While correlated ABV is correlated with both IBU and SRM, the three are theoretically orthogonal to each other. A style-defined attribute like glass type is a bad candidate for a predictor variable because it is completely decoupled from the beer itself and determined entirely by the style the beer has been assigned to.

Get and Prepare Data

Getting beer, the age-old dilemma

base_url <- "http://api.brewerydb.com/v2"
key_preface <- "/?key="

paginated_request <- function(ep, addition, trace_progress = TRUE) {    
  full_request <- NULL
  first_page <- fromJSON(paste0(base_url, "/", ep, "/", key_preface, key
                                , "&p=1"))
  number_of_pages <- ifelse(!(is.null(first_page$numberOfPages)), 
                            first_page$numberOfPages, 1)      

    for (page in 1:number_of_pages) {                               
    this_request <- fromJSON(paste0(base_url, "/", ep, "/", key_preface, key
                                    , "&p=", page, addition),
                             flatten = TRUE) 
    this_req_unnested <- unnest_it(this_request)    #  <- request unnested here
    if(trace_progress == TRUE) {message(paste0("Page ", this_req_unnested$currentPage))}
    full_request <- bind_rows(full_request, this_req_unnested[["data"]])
  }
  return(full_request)
} 

all_beer_raw <- paginated_request("beers", "&withIngredients=Y")
unnest_it <- function(df) {
  unnested <- df
  for(col in seq_along(df[["data"]])) {
    if(! is.null(ncol(df[["data"]][[col]]))) {
      if(! is.null(df[["data"]][[col]][["name"]])) {
        unnested[["data"]][[col]] <- df[["data"]][[col]][["name"]]
      } else {
        unnested[["data"]][[col]] <- df[["data"]][[col]][[1]]
      }
    }
  }
  return(unnested)
}

Collapse Styles

keywords <- c("Lager", "Pale Ale", "India Pale Ale", "Double India Pale Ale", "India Pale Lager", "Hefeweizen", "Barrel-Aged","Wheat", "Pilsner", "Pilsener", "Amber", "Golden", "Blonde", "Brown", "Black", "Stout", "Porter", "Red", "Sour", "Kölsch", "Tripel", "Bitter", "Saison", "Strong Ale", "Barley Wine", "Dubbel", "Altbier")

collapse_styles <- function(df, trace_progress = TRUE) {
  
  df[["style_collapsed"]] <- vector(length = nrow(df))
  
  for (beer in 1:nrow(df)) {
    if (grepl(paste(keywords, collapse="|"), df$style[beer])) {    
      for (keyword in keywords) {         
        if(grepl(keyword, df$style[beer]) == TRUE) {
          df$style_collapsed[beer] <- keyword    
        }                         
      } 
    } else {
      df$style_collapsed[beer] <- as.character(df$style[beer])       
    }
    if(trace_progress == TRUE) {message(paste0("Collapsing this ", df$style[beer], " to: ", df$style_collapsed[beer]))}
  }
  return(df)
}
collapse_further <- function(df) {
  df[["style_collapsed"]] <- df[["style_collapsed"]] %>%
    fct_collapse(
      "Wheat" = c("Hefeweizen", "Wheat"),
      "Pilsener" = c("Pilsner", "American-Style Pilsener") # pilsener == pilsner == pils
    )
  return(df)
}

Split out Ingredients

When we unnested ingredients, we just concatenated all of the ingredients for a given beer into a long string. If we want, we can split out the ingredients that were concatenated in <ingredient>_name with this split_ingredients function.

This takes a vector of ingredients_to_split, so e.g. c("hops_name", "malt_name") and creates one column for each type of ingredient (hops_name_1, hops_name_2, etc.). It’s flexible enough to adapt if data in BreweryDB changes and a beer now has 15 hops where before the maximum number of hops a beer had was 10.

split_ingredients <- function(df, ingredients_to_split) {
  
  ncol_df <- ncol(df)
  
  for (ingredient in ingredients_to_split) {

    ingredient_split <- str_split(df[[ingredient]], ", ")    
    num_new_cols <- max(lengths(ingredient_split))    
  
    for (num in 1:num_new_cols) {
      
      this_col <- ncol_df + 1         
      
      df[, this_col] <- NA
      names(df)[this_col] <- paste0(ingredient, "_", num)
      ncol_df <- ncol(df)             
      for (row in seq_along(ingredient_split)) {          
        if (!is.null(ingredient_split[[row]][num])) {        
          df[row, this_col] <- ingredient_split[[row]][num]
        }
      }
      df[[names(df)[this_col]]] <- factor(df[[names(df)[this_col]]])
    }
    
    ncol_df <- ncol(df)
  }
  return(df)
}

Some quick summary stats on our main dataframe called beer_necessities:

dim(beer_necessities)
[1] 63495    39
str(beer_necessities)
'data.frame':   63495 obs. of  39 variables:
 $ id              : chr  "cBLTUw" "ZsQEJt" "tmEthz" "b7SfHG" ...
 $ name            : chr  "\"18\" Imperial IPA 2" "\"633\" American Pale Ale" "\"Admiral\" Stache" "\"Ah Me Joy\" Porter" ...
 $ description     : chr  "Hop Heads this one's for you!  Checking in with 143 IBU's this ale punches you in the mouth with extreme bitterness then rounds"| __truncated__ "Our first beer has been aptly named \"633\" after the Regions telephone exchange for starters.  \"If I could call a beer home, "| __truncated__ "Milwaukee Brewing Co’s take on a classic European style. Baltic Porters are the stronger lager fermented cousin of the classic "| __truncated__ "A robust porter style ale with a twist. This beer has moderate roastiness with a bitter finish, complemented by the sweetness o"| __truncated__ ...
 $ style           : Factor w/ 170 levels "Adambier","Aged Beer (Ale or Lager)",..: 13 20 30 139 23 108 8 20 7 54 ...
 $ abv             : num  11.1 6.33 7 5.4 4.8 4.6 8.5 5.8 7.6 10.8 ...
 $ ibu             : num  NA 25 23 51 12 NA 30 51 80 70 ...
 $ srm             : num  33 NA 37 40 NA 5 NA 8 NA NA ...
 $ glass           : Factor w/ 12 levels "Flute","Goblet",..: 6 NA 6 NA NA NA NA NA NA NA ...
 $ hops_name       : Factor w/ 969 levels "","#06300","Admiral, Aurora, Challenger, Fuggle (American), Target",..: NA NA 902 NA NA NA NA NA NA NA ...
 $ hops_id         : Factor w/ 969 levels "","1, 22, 23, 25, 146",..: NA NA 955 NA NA NA NA NA NA NA ...
 $ malt_name       : Factor w/ 923 levels "","Abbey Malt",..: NA NA 143 NA NA NA NA NA NA NA ...
 $ malt_id         : Factor w/ 923 levels "","165","165, 1947, 633, 1922",..: NA NA 124 NA NA NA NA NA NA NA ...
 $ glasswareId     : num  5 NA 5 NA NA NA NA NA NA NA ...
 $ styleId         : Factor w/ 170 levels "1","10","100",..: 109 89 7 82 106 101 102 89 107 68 ...
 $ style.categoryId: num  3 3 9 1 3 3 3 3 3 1 ...
 $ style_collapsed : Factor w/ 108 levels "Adambier","Altbier",..: 101 81 84 84 95 21 24 81 20 101 ...
 $ hops_name_1     : Factor w/ 113 levels "","#06300","Admiral",..: NA NA 90 NA NA NA NA NA NA NA ...
 $ hops_name_2     : Factor w/ 98 levels "Amarillo","Apollo",..: NA NA 70 NA NA NA NA NA NA NA ...
 $ hops_name_3     : Factor w/ 90 levels "Amarillo","Aramis",..: NA NA NA NA NA NA NA NA NA NA ...
 $ hops_name_4     : Factor w/ 63 levels "Amarillo","Apollo",..: NA NA NA NA NA NA NA NA NA NA ...
 $ hops_name_5     : Factor w/ 50 levels "Australian Dr. Rudi",..: NA NA NA NA NA NA NA NA NA NA ...
 $ hops_name_6     : Factor w/ 29 levels "Cascade","Columbus",..: NA NA NA NA NA NA NA NA NA NA ...
 $ hops_name_7     : Factor w/ 20 levels "Azzeca","Crystal",..: NA NA NA NA NA NA NA NA NA NA ...
 $ hops_name_8     : Factor w/ 10 levels "Equinox","Experimental 06277",..: NA NA NA NA NA NA NA NA NA NA ...
 $ hops_name_9     : Factor w/ 4 levels "Motueka","Nugget",..: NA NA NA NA NA NA NA NA NA NA ...
 $ hops_name_10    : Factor w/ 4 levels "Nelson Sauvin",..: NA NA NA NA NA NA NA NA NA NA ...
 $ hops_name_11    : Factor w/ 4 levels "Simcoe","Styrian Bobeks",..: NA NA NA NA NA NA NA NA NA NA ...
 $ hops_name_12    : Factor w/ 3 levels "Summit","Super Galena",..: NA NA NA NA NA NA NA NA NA NA ...
 $ hops_name_13    : Factor w/ 2 levels "Target","Willamette": NA NA NA NA NA NA NA NA NA NA ...
 $ malt_name_1     : Factor w/ 128 levels "","Abbey Malt",..: NA NA 9 NA NA NA NA NA NA NA ...
 $ malt_name_2     : Factor w/ 134 levels "Amber Malt","Barley - Flaked",..: NA NA 64 NA NA NA NA NA NA NA ...
 $ malt_name_3     : Factor w/ 122 levels "Acidulated Malt",..: NA NA 73 NA NA NA NA NA NA NA ...
 $ malt_name_4     : Factor w/ 94 levels "Bamberg Smoked Malt",..: NA NA 52 NA NA NA NA NA NA NA ...
 $ malt_name_5     : Factor w/ 62 levels "Asheburne Mild Malt",..: NA NA NA NA NA NA NA NA NA NA ...
 $ malt_name_6     : Factor w/ 41 levels "Aromatic Malt",..: NA NA NA NA NA NA NA NA NA NA ...
 $ malt_name_7     : Factor w/ 19 levels "Barley - Roasted",..: NA NA NA NA NA NA NA NA NA NA ...
 $ malt_name_8     : Factor w/ 15 levels "Crisp 120","Crisp 77",..: NA NA NA NA NA NA NA NA NA NA ...
 $ malt_name_9     : Factor w/ 6 levels "Rye Malt","Smoked Malt",..: NA NA NA NA NA NA NA NA NA NA ...
 $ malt_name_10    : Factor w/ 1 level "Victory Malt": NA NA NA NA NA NA NA NA NA NA ...

Find the Most Popualar Styles

We find mean ABV, IBU, and SRM per collapsed style and arrange collapsed styles by the number of beers that fall into them. (This is of course dependent on how we collapse styles; if we looped all Double IPAs in with IPAs then the category IPA would be much bigger than it is if we keep the two separate.)

library(forcats)
# Pare down to only cases where style is not NA
beer_dat_pared <- beer_necessities[complete.cases(beer_necessities$style), ]
# Arrange beer dat by style popularity
style_popularity <- beer_dat_pared %>% 
  group_by(style) %>% 
  count() %>% 
  arrange(desc(n))
# Add a column that scales popularity
style_popularity <- bind_cols(style_popularity, 
                               n_scaled = as.vector(scale(style_popularity$n)))
# Find styles that are above a z-score of 0
popular_styles <- style_popularity %>% 
  filter(n_scaled > 0)
# Pare dat down to only beers that fall into those styles
popular_beer_dat <- beer_dat_pared %>% 
  filter(
    style %in% popular_styles$style
  ) %>% 
  droplevels() %>% 
  as_tibble() 

How many rows do we have in our dataset of just beers that fall into the popular styles?

nrow(popular_beer_dat)
[1] 45871

Now we find the style centers.

# Find the centers (mean abv, ibu, srm) of the most popular styles
style_centers <- popular_beer_dat %>% 
  group_by(style_collapsed) %>% 
  add_count() %>% 
  summarise(
    mean_abv = mean(abv, na.rm = TRUE),
    mean_ibu = mean(ibu, na.rm = TRUE), 
    mean_srm = mean(srm, na.rm = TRUE),
    n = median(n, na.rm = TRUE)          # Median here only for summarise. Should be just the same as n
  ) %>% 
  arrange(desc(n)) %>% 
  drop_na() %>% 
  droplevels()
# Give some nicer names
style_centers_rename <- style_centers %>% 
  rename(
    `Collapsed Style` = style_collapsed,
    `Mean ABV` = mean_abv,
    `Mean IBU` = mean_ibu,
    `Mean SRM` = mean_srm,
    `Numer of Beers` = n
  )

Take a look at the table, ordered by number of beers in that style, descending.

kable(style_centers_rename)
Collapsed Style Mean ABV Mean IBU Mean SRM Numer of Beers
India Pale Ale 6.578468 66.04268 9.989313 6524
Pale Ale 5.695480 40.86930 8.890306 4280
Stout 7.991841 43.89729 36.300000 4238
Wheat 5.158040 17.47168 5.861842 3349
Double India Pale Ale 8.930599 93.48142 11.006873 2525
Red 5.742565 33.81127 16.178862 2521
Lager 5.453718 30.64361 8.457447 2230
Saison 6.400189 27.25114 7.053476 2167
Blonde 5.595298 22.39432 5.625000 2044
Porter 6.182049 33.25369 32.197605 1973
Brown 6.159212 32.21577 23.592000 1462
Pilsener 5.227593 33.51346 4.413462 1268
Specialty Beer 6.446402 33.77676 15.520548 1044
Bitter 5.322364 38.28175 12.460526 939
Fruit Beer 5.195222 19.24049 8.666667 905
Herb and Spice Beer 6.621446 27.77342 18.166667 872
Sour 6.224316 18.88869 10.040816 797
Strong Ale 8.826425 36.74233 22.547945 767
Tripel 9.029775 32.51500 7.680556 734
Black 6.958714 65.50831 31.080000 622
Barley Wine 10.781600 74.04843 19.561404 605
Kölsch 4.982216 23.37183 4.371795 593
Barrel-Aged 9.002506 39.15789 18.133333 540
Other Belgian-Style Ales 7.516318 37.55812 17.549020 506
Pumpkin Beer 6.712839 23.48359 17.918033 458
Dubbel 7.509088 25.05128 22.940000 399
Scotch Ale 7.620233 26.36909 24.222222 393
German-Style Doppelbock 8.045762 28.88692 25.696970 376
Fruit Cider 6.205786 25.60000 12.000000 370
German-Style Märzen 5.746102 25.63796 14.322581 370

Ingredients

To get more granular with ingredients, we can split out each individual ingredient into its own column. If a beer or style contains that ingredient, its row gets a 1 in that ingredient column and a 0 otherwise.

From this, we can find the total number of hops and malts per grouper.

pick_ingredient_get_beer <- function (ingredient_want, df, grouper) {
  
  # ----------------------- Setup --------------------------- #
  # We've already split ingredient number names out from the concatenated string into columns like `malt_name_1`,
  # `malt_name_2`, etc. We need to find the range of these columns; there will be a different number of malt
  # columns than hops columns, for instance. The first one will be `<ingredient>_name_1` and from this we can find
  # the index of this column in our dataframe. We get the name of last one with the `get_last_ing_name_col()`
  # function. Then we save a vector of all the ingredient column names in `ingredient_colnames`. It will stay
  # constant even if the indices change when we select out certain columns. 
  
  # First ingredient
  first_ingredient_name <- paste(ingredient_want, "_name_1", sep="")
  first_ingredient_index <- which(colnames(df)==first_ingredient_name)
  
  # Get the last ingredient
  get_last_ing_name_col <- function(df) {
    for (col in names(df)) {
      if (grepl(paste(ingredient_want, "_name_", sep = ""), col) == TRUE) {
        name_last_ing_col <- col
      }
    }
    return(name_last_ing_col)
  }
  
  # Last ingredient
  last_ingredient_name <- get_last_ing_name_col(df)
  last_ingredient_index <- which(colnames(df)==last_ingredient_name)
  
  # Vector of all the ingredient column names
  ingredient_colnames <- names(df)[first_ingredient_index:last_ingredient_index]
  
  # Non-ingredient column names we want to keep
  to_keep_col_names <- c("id", "cluster_assignment", "name", "abv", "ibu", "srm", "style", "style_collapsed")
  
  # -------------------------------------------------------------------------------# 
  
  # Inside `gather_ingredients()` we take out superflous column names that are not in `to_keep_col_names` or one 
  # of the ingredient columns, find what the new ingredient column indices are, since they'll have changed after 
  # we pared down and then gather all of the ingredient columns (e.g., `hops_name_1`) into one long column, 
  # `ing_keys` and all the actual ingredient names (e.g., Cascade) into `ing_names`.
  
  # ----------------------------- Gather columns --------------------------------- #
  gather_ingredients <- function(df, cols_to_gather) {
    to_keep_indices <- which(colnames(df) %in% to_keep_col_names)
    
    selected_df <- df[, c(to_keep_indices, first_ingredient_index:last_ingredient_index)]
    
    new_ing_indices <- which(colnames(selected_df) %in% cols_to_gather)    # indices will have changed since we pared down 
    
    df_gathered <- selected_df %>%
      gather_(
        key_col = "ing_keys",
        value_col = "ing_names",
        gather_cols = colnames(selected_df)[new_ing_indices]
      ) %>%
      mutate(
        count = 1
      )
    return(df_gathered)
  }
  beer_gathered <- gather_ingredients(df, ingredient_colnames)  # ingredient colnames defined above function
  # ------------------------------------------------------------------------------- # 
  
  # Next we get a vector of all ingredient levels and take out the one that's an empty string and 
  # use this vector of ingredient levels in `select_spread_cols()` below
  # Get a vector of all ingredient levels
  beer_gathered$ing_names <- factor(beer_gathered$ing_names)
  ingredient_levels <- levels(beer_gathered$ing_names) 
  
  # Take out the level that's just an empty string
  to_keep_levels <- !(c(1:length(ingredient_levels)) %in% which(ingredient_levels == ""))
  ingredient_levels <- ingredient_levels[to_keep_levels]
  
  beer_gathered$ing_names <- as.character(beer_gathered$ing_names)
  
  # ----------------------------------------------------------------------------- # 
  
  # Then we spread the ingredient names: we take what was previously the `value` in our gathered dataframe, the
  # actual ingredient names (Cascade, Centennial) and make that our `key`; it'll form the new column names. The
  # new `value` is `value` is count; it'll populate the row cells. If a given row has a certain ingredient, it
  # gets a 1 in the corresponding cell, an NA otherwise. 
  # We add a unique idenfitier for each row with `row`, which we'll drop later (see [Hadley's SO
  # comment](https://stackoverflow.com/questions/25960394/unexpected-behavior-with-tidyr)).
  
  # ------------------------------- Spread columns -------------------------------- #
  spread_ingredients <- function(df) {
    df_spread <- df %>% 
      mutate(
        row = 1:nrow(df)        # Add a unique idenfitier for each row which we'll need in order to spread; we'll drop this later
      ) %>%                                 
      spread(
        key = ing_names,
        value = count
      ) 
    return(df_spread)
  }
  beer_spread <- spread_ingredients(beer_gathered)
  # ------------------------------------------------------------------------------- # 
  
  # ------------------------- Select only certain columns ------------------------- #
  select_spread_cols <- function(df) {
    to_keep_col_indices <- which(colnames(df) %in% to_keep_col_names)
    to_keep_ingredient_indices <- which(colnames(df) %in% ingredient_levels)
    
    to_keep_inds_all <- c(to_keep_col_indices, to_keep_ingredient_indices)
    
    new_df <- df %>% 
      select_(
        .dots = to_keep_inds_all
      )
    return(new_df)
  }
  beer_spread_selected <- select_spread_cols(beer_spread)
  # ------------------------------------------------------------------------------- # 
  # Take out all rows that have no ingredients specified at all
  inds_to_remove <- apply(beer_spread_selected[, first_ingredient_index:last_ingredient_index], 
                          1, function(x) all(is.na(x)))
  beer_spread_no_na <- beer_spread_selected[ !inds_to_remove, ]
  
  
  # ----------------- Group ingredients by the grouper specified ------------------- #
  # Then we do the final step and group by the groupers.
  
  get_ingredients_per_grouper <- function(df, grouper = grouper) {
    df_grouped <- df %>%
      ungroup() %>% 
      group_by_(grouper)
    
    not_for_summing <- which(colnames(df_grouped) %in% to_keep_col_names)
    max_not_for_summing <- max(not_for_summing)
    
    browser()
    per_grouper <- df_grouped %>% 
      select(-c(abv, ibu, srm)) %>%    # taking out temporarily
      summarise_if(
        is.numeric,              
        sum, na.rm = TRUE
        # -c(abv, ibu, srm)
      ) %>%
      mutate(
        total = rowSums(.[(max_not_for_summing + 1):ncol(.)], na.rm = TRUE)    
      )
    
    # Send total to the second position
    per_grouper <- per_grouper %>% 
      select(
        id, total, everything()
      )
    
    # Replace total column with more descriptive name: total_<ingredient>
    names(per_grouper)[which(names(per_grouper) == "total")] <- paste0("total_", ingredient_want)
    
    return(per_grouper)
  }
  # ------------------------------------------------------------------------------- # 
  
  ingredients_per_grouper <- get_ingredients_per_grouper(beer_spread_selected, grouper)
  return(ingredients_per_grouper)
}
# Same for malt
ingredients_per_beer_malt <- pick_ingredient_get_beer(ingredient_want = "malt", 
                                                      beer_necessities, 
                                                      grouper = c("id"))
Called from: get_ingredients_per_grouper(beer_spread_selected, grouper)
debug at #137: per_grouper <- df_grouped %>% select(-c(abv, ibu, srm)) %>% summarise_if(is.numeric, 
    sum, na.rm = TRUE) %>% mutate(total = rowSums(.[(max_not_for_summing + 
    1):ncol(.)], na.rm = TRUE))
debug at #149: per_grouper <- per_grouper %>% select(id, total, everything())
debug at #155: names(per_grouper)[which(names(per_grouper) == "total")] <- paste0("total_", 
    ingredient_want)
debug at #157: return(per_grouper)
# Join those on our original dataframe by name
beer_ingredients_join_first_ingredient <- left_join(beer_necessities, ingredients_per_beer_hops,
                                                    by = "id")
beer_ingredients_join <- left_join(beer_ingredients_join_first_ingredient, ingredients_per_beer_malt,
                                   by = "id")
# Take out some unnecessary columns
unnecessary_cols <- c("styleId", "abv_scaled", "ibu_scaled", "srm_scaled", 
                      "hops_id", "malt_id", "glasswareId", "style.categoryId")
beer_ingredients_join <- beer_ingredients_join[, (! names(beer_ingredients_join) %in% unnecessary_cols)]

Now we’re left with something of a sparse matrix of all the ingredients compared to all the beers

kable(beer_ingredients_join[1:20, ])
id name total_hops total_malt style abv ibu srm glass hops_name malt_name style_collapsed #06300 Admiral Aged / Debittered Hops (Lambic) Ahtanum Alchemy Amarillo Amarillo Gold Apollo Aquila Aramis Argentine Cascade Athanum Aurora Australian Dr. Rudi Azacca Azzeca Belma Bobek Bramling Cross Bravo Brewer's Gold Brewer's Gold (American) Calypso Cascade Celeia Centennial Challenger Chinook Citra Cluster Cobb Columbus Columbus (Tomahawk) Comet Crystal CTZ Delta East Kent Golding El Dorado Ella Enigma Equinox Eureka Experimental 05256 Experimental 06277 Falconer's Flight First Gold French Strisserspalt French Triskel Fuggle (American) Fuggle (English) Fuggles Galaxy Galena German Magnum German Mandarina Bavaria German Opal German Perle German Polaris German Select German Tradition Glacier Golding (American) Green Bullet Hallertau Hallertauer Mittelfrüher Hallertau Hallertauer Tradition Hallertau Northern Brewer Hallertauer (American) Hallertauer Herkules Hallertauer Hersbrucker Hallertauer Perle Hallertauer Select Helga Hop Extract Hops Horizon Huell Melon Idaho 7 Jarrylo Kent Goldings Kohatu Lemon Drop Liberty Magnum Marynka Meridian Millenium Mosaic Motueka Mount Hood Mt. Rainier Nelson Sauvin New Zealand Hallertauer New Zealand Motueka New Zealand Sauvin Newport Noble Northdown Northern Brewer (American) Nugget Orbit Pacific Gem Pacific Jade Pacifica Palisades Perle (American) Phoenix Pilgrim Premiant Pride of Ringwood Rakau Revolution Saaz (American) Saaz (Czech) Santiam Saphir (German Organic) Simcoe Sladek (Saaz) Sorachi Ace Southern Cross Sovereign Spalt Spalt Select Spalt Spalter Sterling Sticklebract Strisselspalt Styrian Aurora Styrian Bobeks Styrian Goldings Summit Super Galena Target Tettnang Tettnanger Tettnanger (American) Tomahawk Topaz Tradition Ultra Vanguard Vic Secret Waimea Wakatu Warrior Willamette Yakima Willamette Zeus Zythos Abbey Malt Acidulated Malt Amber Malt Aromatic Malt Asheburne Mild Malt Bamberg Smoked Malt Barley - Black Barley - Flaked Barley - Lightly Roasted Barley - Malted Barley - Raw Barley - Roasted Barley - Roasted/De-husked Beechwood Smoked Belgian Pale Belgian Pilsner Biscuit Malt Black Malt Black Malt - Debittered Black Malt - Organic Black Patent Black Roast Blackprinz Malt Blue Agave Nectar Blue Corn Bonlander Briess 2-row Chocolate Malt Briess Blackprinz Malt British Pale Malt Brown Malt Brown Sugar Buckwheat - Roasted C-15 Canada 2-Row Silo Cane Sugar Cara Malt CaraAmber CaraAroma CaraBrown Carafa I Carafa II Carafa III Carafa Special CaraFoam CaraHell Caramel/Crystal Malt Caramel/Crystal Malt - Dark Caramel/Crystal Malt - Extra Dark Caramel/Crystal Malt - Heritage Caramel/Crystal Malt - Light Caramel/Crystal Malt - Medium Caramel/Crystal Malt - Organic Caramel/Crystal Malt 10L Caramel/Crystal Malt 120L Caramel/Crystal Malt 150L Caramel/Crystal Malt 15L Caramel/Crystal Malt 20L Caramel/Crystal Malt 300L Caramel/Crystal Malt 30L Caramel/Crystal Malt 40L Caramel/Crystal Malt 45L Caramel/Crystal Malt 50L Caramel/Crystal Malt 55L Caramel/Crystal Malt 60L Caramel/Crystal Malt 70L Caramel/Crystal Malt 75L Caramel/Crystal Malt 80L Caramel/Crystal Malt 85L Caramel/Crystal Malt 8L Caramel/Crystal Malt 90L CaraMunich CaraMunich 120L CaraMunich 20L CaraMunich 40L CaraMunich 60L CaraMunich I CaraMunich II CaraMunich III CaraPils/Dextrin Malt CaraRed CaraRye CaraStan CaraVienne Malt CaraWheat Carolina Rye Malt Cereal Cherry Smoked Cherrywood Smoke Malt Chit Malt Chocolate Malt Chocolate Rye Malt Chocolate Wheat Malt Coffee Malt Corn Corn - Field Corn - Flaked Corn Grits Crisp 120 Crisp 77 Crystal 77 Dark Chocolate Dememera Sugar Dextrin Malt Dextrose Syrup Extra Special Malt Fawcett Crystal Rye Fawcett Rye German Cologne Gladfield Pale Glen Eagle Maris Otter Golden Promise Harrington 2-Row Base Malt High Fructose Corn Syrup Honey Honey Malt Hugh Baird Pale Ale Malt Kiln Amber Lactose Lager Malt Malt Extract Malted Rye Malto Franco-Belge Pils Malt Maple Syrup Maris Otter Melanoidin Malt Metcalfe Midnight Wheat Mild Malt Millet Munich Malt Munich Malt - Dark Munich Malt - Light Munich Malt - Organic Munich Malt - Smoked Munich Malt - Type I Munich Malt - Type II Munich Malt 10L Munich Malt 20L Munich Malt 40L Munich Wheat Oats - Flaked Oats - Golden Naked Oats - Malted Oats - Rolled Oats - Steel Cut (Pinhead Oats) Oats - Toasted Pale Chocolate Malt Pale Malt Pale Malt - Halcyon Pale Malt - Optic Pale Malt - Organic Pale Wheat Palev Pearl Malt Peated Malt - Smoked Piloncillo Pilsner Malt Pilsner Malt - Organic Rahr 2-Row Malt Rahr Special Pale Rauchmalz Rice Rice - Flaked Rice - Hulls Rice - Red Rice - White Roast Malt Rye - Flaked Rye Malt Samuel Adams two-row pale malt blend Six-Row Pale Malt Smoked Malt Special B Malt Special Roast Special W Malt Spelt Malt Sugar (Albion) Toasted Malt Torrefied Wheat Two-Row Barley Malt Two-Row Pale Malt Two-Row Pale Malt - Organic Two-Row Pale Malt - Toasted Two-Row Pilsner Malt Two-Row Pilsner Malt - Belgian Two-Row Pilsner Malt - Germany Victory Malt Vienna Malt Weyermann Rye Wheat - Flaked Wheat - Raw Wheat - Red Wheat - Toasted Wheat - Torrified Wheat Malt Wheat Malt - Dark Wheat Malt - German Wheat Malt - Light Wheat Malt - Organic Wheat Malt - Red Wheat Malt - Smoked Wheat Malt - White White Wheat Wyermann Vienna
cBLTUw "18" Imperial IPA 2 0 0 American-Style Imperial Stout 11.10 NA 33 Pint NA NA Stout 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
ZsQEJt "633" American Pale Ale 0 0 American-Style Pale Ale 6.33 25.0 NA NA NA NA Pale Ale 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
tmEthz "Admiral" Stache 2 4 Baltic-Style Porter 7.00 23.0 37 Pint Perle (American), Saaz (American) Barley - Malted, Chocolate Malt, Munich Malt, Oats - Flaked Porter 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
b7SfHG "Ah Me Joy" Porter 0 0 Robust Porter 5.40 51.0 40 NA NA NA Porter 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
zcJMId "Alternating Currant" Sour 0 0 American-Style Sour Ale 4.80 12.0 NA NA NA NA Sour 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UM8GL6 "B" Street Pineapple Blonde 0 0 Golden or Blonde Ale 4.60 NA 5 NA NA NA Blonde 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
NIaY9C "B.B. Rodriguez" Double Brown 0 0 American-Style Brown Ale 8.50 30.0 NA NA NA NA Brown 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
PBEXhV "Bison Eye Rye" Pale Ale | 2 of 4 Part Pale Ale Series 0 0 American-Style Pale Ale 5.80 51.0 8 NA NA NA Pale Ale 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
wRmmdv "California Crude" Black IPA 0 0 American-Style Black Ale 7.60 80.0 NA NA NA NA Black 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
EPYNpW "C’est Noir" Imperial Stout 0 0 British-Style Imperial Stout 10.80 70.0 NA NA NA NA Stout 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
AXmvOd "Dust Up" Cloudy Pale Ale | 1 of 4 Part Pale Ale Series 0 0 American-Style Pale Ale 5.40 54.0 11 NA NA NA Pale Ale 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
c5pZg5 "EVL1" Imperial Red Ale 0 0 Imperial Red Ale 10.40 64.0 NA NA NA NA Red 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
xBKAka "Galactic Wrath" IPA 0 0 American-Style India Pale Ale 7.50 75.0 NA NA NA NA India Pale Ale 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
Hr5A0t "God Country" Kolsch 0 0 German-Style Kölsch / Köln-Style Kölsch 5.60 28.2 5 NA NA NA Kölsch 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
UjFyXJ "Hey Victor" Smoked Porter 0 0 Smoke Beer (Lager or Ale) 5.50 NA NA NA NA NA Lager 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
5UcMBc "Ignition" IPA 0 0 American-Style India Pale Ale 6.60 45.0 NA Pint NA NA India Pale Ale 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
mrVjY4 "Jemez Field Notes" Golden Lager 0 0 Golden or Blonde Ale 4.90 20.0 5 NA NA NA Blonde 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
54rSgo "Jemmy Dean" Breakfast Stout 0 0 Sweet or Cream Stout NA NA NA Pint NA NA Stout 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
JsKjkk "Mauvaises Choses" 0 0 Belgian-Style Pale Strong Ale 7.00 30.0 NA Tulip NA NA Strong Ale 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
b7WWL6 "Mike Saw a Sasquatch" Session Ale 2 2 Golden or Blonde Ale 4.70 26.0 NA Pint Cascade, Sterling Honey Malt, Two-Row Pale Malt Blonde 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Now that the munging is done, onto the main question: do natural clusters in beer align with style boundaries?


Unsupervised Clustering

We K-means cluster beers based on certain numeric predictor variables.

Prep

library(NbClust)
cluster_it <- function(df, preds, to_scale, resp, n_centers) {
  df_for_clustering <- df %>%
    select_(.dots = c(response_vars, cluster_on)) %>%
    na.omit() %>%
    filter(
      abv < 20 & abv > 3
    ) %>%
    filter(
      ibu < 200
    )
  df_all_preds <- df_for_clustering %>%
    select_(.dots = preds)
  df_preds_scale <- df_all_preds %>%
    select_(.dots = to_scale) %>%
    rename(
      abv_scaled = abv,
      ibu_scaled = ibu,
      srm_scaled = srm
    ) %>%
    scale() %>%
    as_tibble()
  df_preds <- bind_cols(df_preds_scale, df_all_preds[, (!names(df_all_preds) %in% to_scale)])
  df_outcome <- df_for_clustering %>%
    select_(.dots = resp) %>%
    na.omit()
  set.seed(9)
  clustered_df_out <- kmeans(x = df_preds, centers = n_centers, trace = FALSE)
  clustered_df <- as_tibble(data.frame(
    cluster_assignment = factor(clustered_df_out$cluster),
    df_outcome, df_preds,
    df_for_clustering %>% select(abv, ibu, srm)))
  return(clustered_df)
}

Cluster

First we’ll run the fuction with 10 centers, and cluster on the predictors ABV, IBU, SRM, total_hops, and total_malt.

cluster_on <- c("abv", "ibu", "srm", "total_hops", "total_malt")
to_scale <- c("abv", "ibu", "srm", "total_hops", "total_malt")
response_vars <- c("name", "style", "style_collapsed")
clustered_beer <- cluster_it(df = beer_totals,
                             preds = cluster_on,
                             to_scale = to_scale,
                             resp = response_vars,
                             n_centers = 10)

Head of the resulting clustered data. Cluster assignment column on the far left.

kable(clustered_beer[1:20, ])

cluster_assignment name style style_collapsed abv_scaled ibu_scaled srm_scaled total_hops total_malt abv ibu srm
10 "Admiral" Stache Baltic-Style Porter Porter 0.2700989 -0.7075654 2.1858706 0.4674779 1.1440890 7.0 23.0 37
10 "Ah Me Joy" Porter Robust Porter Porter -0.6074754 0.3844558 2.4677869 -0.1933839 -0.2023226 5.4 51.0 40
6 "Bison Eye Rye" Pale Ale | 2 of 4 Part Pale Ale Series American-Style Pale Ale Pale Ale -0.3880818 0.3844558 -0.5393202 -0.1933839 -0.2023226 5.8 51.0 8
6 "Dust Up" Cloudy Pale Ale | 1 of 4 Part Pale Ale Series American-Style Pale Ale Pale Ale -0.6074754 0.5014580 -0.2574039 -0.1933839 -0.2023226 5.4 54.0 11
3 "God Country" Kolsch German-Style Kölsch / Köln-Style Kölsch Kölsch -0.4977786 -0.5047614 -0.8212365 -0.1933839 -0.2023226 5.6 28.2 5
3 "Jemez Field Notes" Golden Lager Golden or Blonde Ale Blonde -0.8817174 -0.8245676 -0.8212365 -0.1933839 -0.2023226 4.9 20.0 5
3 #10 Hefewiezen South German-Style Hefeweizen / Hefeweissbier Wheat -0.7720206 -1.1755744 -0.9152086 -0.1933839 -0.2023226 5.1 11.0 4
3 #9 American-Style Pale Ale Pale Ale -0.7720206 -0.8245676 -0.4453481 0.4674779 0.4708832 5.1 20.0 9
3 #KoLSCH German-Style Kölsch / Köln-Style Kölsch Kölsch -0.9365658 -0.5515624 -1.0091807 -0.1933839 -0.2023226 4.8 27.0 3
3 'Inappropriate' Cream Ale American-Style Cream Ale or Lager Lager -0.6623238 -0.9025691 -0.8212365 -0.1933839 -0.2023226 5.3 18.0 5
8 'tis the Saison French & Belgian-Style Saison Saison 0.2700989 -0.4345601 -0.6332923 -0.1933839 -0.2023226 7.0 30.0 7
3 (306) URBAN WHEAT BEER Belgian-Style White (or Wit) / Belgian-Style Wheat Wheat -0.8268690 -0.8245676 -0.4453481 -0.1933839 -0.2023226 5.0 20.0 9
4 (512) Bruin (A.K.A. Brown Bear) American-Style Brown Ale Brown 0.5991893 -0.4345601 0.6823171 0.1370470 1.1440890 7.6 30.0 21
8 (512) FOUR Strong Ale Strong Ale 0.5443409 -0.2395563 -0.5393202 0.7979088 1.1440890 7.5 35.0 8
7 (512) IPA American-Style India Pale Ale India Pale Ale 0.2700989 0.9304663 -0.5393202 0.7979088 0.8074861 7.0 65.0 8
8 (512) ONE Belgian-Style Pale Strong Ale Strong Ale 0.8185829 -0.7465661 -0.5393202 -0.1933839 0.4708832 8.0 22.0 8
6 (512) Pale American-Style Pale Ale Pale Ale -0.2783850 -0.4345601 -0.6332923 0.7979088 0.8074861 6.0 30.0 7
10 (512) SIX Belgian-Style Dubbel Dubbel 0.5443409 -0.6295639 1.3401218 0.4674779 0.8074861 7.5 25.0 28
8 (512) THREE Belgian-Style Tripel Tripel 1.6413088 -0.7465661 -0.3513760 0.1370470 0.8074861 9.5 22.0 10
9 (512) THREE (Cabernet Barrel Aged) Belgian-Style Tripel Tripel 1.6413088 -0.7465661 2.4677869 -0.1933839 -0.2023226 9.5 22.0 40

# How many rows do we have?
nrow(clustered_beer)
[1] 3918

Join the clustered beer on beer_ingredients_join

beer_ingredients_join_clustered <- left_join(beer_ingredients_join, clustered_beer, 
                                             by = "name")

A table of cluster counts broken down by style

cluster_table_counts <- table(style = clustered_beer$style_collapsed, cluster = clustered_beer$cluster_assignment)
kable(cluster_table_counts)
1 2 3 4 5 6 7 8 9 10
Barley Wine 0 28 0 0 14 0 2 7 11 0
Barrel-Aged 0 3 2 4 6 3 1 11 15 3
Bitter 0 0 17 20 0 38 2 1 1 1
Black 0 0 0 1 18 0 7 0 0 17
Blonde 0 0 118 2 0 13 1 24 1 1
Brown 0 1 8 95 3 2 6 0 6 27
Double India Pale Ale 0 171 0 0 11 0 45 4 1 0
Dubbel 0 0 0 16 0 0 1 7 6 11
Fruit Beer 0 0 36 7 0 2 4 4 2 1
Fruit Cider 0 0 1 0 0 0 0 0 0 0
German-Style Doppelbock 0 0 0 5 1 0 0 5 12 6
German-Style Märzen 11 0 8 10 0 1 0 0 0 0
Herb and Spice Beer 0 0 13 13 0 4 6 3 4 12
India Pale Ale 15 18 6 7 10 100 413 3 0 5
Kölsch 0 0 67 1 0 3 1 0 0 0
Lager 0 3 135 50 4 28 27 10 3 7
Other Belgian-Style Ales 0 0 4 7 1 4 9 4 5 5
Pale Ale 19 2 57 25 3 229 49 11 1 2
Pilsener 0 1 74 0 1 54 3 3 0 0
Porter 0 0 0 36 9 1 0 1 10 127
Pumpkin Beer 0 0 7 18 0 2 0 9 5 5
Red 0 8 33 125 13 46 21 7 4 16
Saison 0 0 52 6 1 34 2 41 0 3
Scotch Ale 0 0 0 10 1 0 0 5 7 10
Sour 0 0 18 4 0 3 1 4 5 2
Specialty Beer 0 1 15 13 0 5 5 11 5 10
Stout 0 0 2 6 49 2 1 3 14 126
Strong Ale 0 4 0 5 1 2 5 29 33 3
Tripel 0 2 0 0 1 1 0 57 4 0
Wheat 0 0 268 12 0 17 4 11 2 3

Plot the clusters. There are 3 axes: ABV, IBU, and SRM, so we choose two at a time.

clustered_beer_plot_abv_ibu <- ggplot(data = clustered_beer, aes(x = abv, y = ibu, colour = cluster_assignment)) + 
  geom_jitter() + theme_minimal()  +
  ggtitle("k-Means Clustering of Beer by ABV, IBU, SRM") +
  labs(x = "ABV", y = "IBU") +
  labs(colour = "Cluster Assignment")
clustered_beer_plot_abv_ibu

clustered_beer_plot_abv_srm <- ggplot(data = clustered_beer, aes(x = abv, y = srm, colour = cluster_assignment)) + 
  geom_jitter() + theme_minimal()  +
  ggtitle("k-Means Clustering of Beer by ABV, IBU, SRM") +
  labs(x = "ABV", y = "SRM") +
  labs(colour = "Cluster Assignment")
clustered_beer_plot_abv_srm

Now we can add in the style centers (means) for each style_collapsed and label it.

library(ggrepel)
abv_ibu_clusters_vs_style_centers <- ggplot() +   
  geom_point(data = clustered_beer, 
             aes(x = abv, y = ibu, colour = cluster_assignment), alpha = 0.5) +
  geom_point(data = style_centers,
             aes(mean_abv, mean_ibu), colour = "black") +
  geom_text_repel(data = style_centers, aes(mean_abv, mean_ibu, label = style_collapsed), 
                  box.padding = unit(0.45, "lines"),
                  family = "Calibri",
                  label.size = 0.3) +
  ggtitle("Popular Styles vs. k-Means Clustering of Beer by ABV, IBU, SRM") +
  labs(x = "ABV", y = "IBU") +
  labs(colour = "Cluster Assignment") +
  theme_bw()
abv_ibu_clusters_vs_style_centers

The clustering above used a smaller number of clusters (10) than there are styles_collapsed. That makes it difficult to determine whether a given style fits snugly into a cluster or not.

Cluster on just certain selected styles

We’ll take five very distinct collapsed styles and re-run the clustering on beers that fall into these categories. These styles were intentionally chosen because they are quite distinct: Blonde, IPA, Stout, Tripel, Wheat. Arguably, of these five styles Blondes and Wheats are the closest

styles_to_keep <- c("Blonde", "India Pale Ale", "Stout", "Tripel", "Wheat")
bt_certain_styles <- beer_totals %>%
  filter(
    style_collapsed %in% styles_to_keep
  ) %>% 
  droplevels()
cluster_on <- c("abv", "ibu", "srm", "total_hops", "total_malt")
to_scale <- c("abv", "ibu", "srm", "total_hops", "total_malt")
response_vars <- c("name", "style", "style_collapsed")
certain_styles_clustered <- cluster_it(df = bt_certain_styles,
                                 preds = cluster_on,
                                 to_scale = to_scale,
                                 resp = response_vars,
                                 n_centers = 5)
style_centers_certain_styles <- style_centers %>% 
  filter(style_collapsed %in% styles_to_keep)

Table of style vs. cluster.

kable(table(style = certain_styles_clustered$style_collapsed, cluster = certain_styles_clustered$cluster_assignment))

Now that we have a manageable number of styles, we can see how well fit each cluster is to each style. If the features we clustered on perfectly predicted style, there would each color (cluster) would be unique to each facet of the plot. (E.g., left entirely blue, second from left entirely green, etc.)

by_style_plot <- ggplot() +   
  geom_point(data = certain_styles_clustered, 
             aes(x = abv, y = ibu,
                 colour = cluster_assignment), alpha = 0.5) +
  facet_grid(. ~ style_collapsed) +
  geom_point(data = style_centers_certain_styles,
           aes(mean_abv, mean_ibu), colour = "black", shape = 5) +
  ggtitle("Selected Styles Cluster Assignment") +
  labs(x = "ABV", y = "IBU") +
  labs(colour = "Cluster") +
  theme_bw()
by_style_plot

–>

Random asides into hops

Do more hops always mean more bitterness?

ggplot(data = beer_ingredients_join, aes(total_hops, ibu)) +
  geom_point(aes(total_hops, ibu, colour = style_collapsed)) +
  geom_smooth(method = lm, se = FALSE, colour = "black") + 
  ggtitle("Hops Per Beer vs. Bitterness") +
  labs(x = "Number of Hops", y = "IBU", colour = "Style Collapsed") +
  theme_minimal()

Regressing total number of hops on bitterness (IBU):

hops_ibu_lm <- lm(ibu ~ total_hops, data = beer_ingredients_join)
summary(hops_ibu_lm)
ggplot(data = beer_ingredients_join[which(beer_ingredients_join$total_hops > 2
                                          & beer_ingredients_join$total_hops < 8), ], aes(total_hops, ibu)) +
  geom_point(aes(total_hops, ibu, colour = style_collapsed)) +
  geom_smooth(method = lm, se = FALSE, colour = "black") +
  ggtitle("3+ Hops Per Beer vs. Bitterness") +
  labs(x = "Number of Hops", y = "IBU", colour = "Style Collapsed") +
  theme_minimal()

Most popular hops

# Gather up all the hops columns into one called `hop_name`
beer_necessities_hops_gathered <- beer_necessities %>%
  gather(
    hop_key, hop_name, hops_name_1:hops_name_13
  ) %>% as_tibble()

# Filter to just those beers that have at least one hop
beer_necessities_w_hops <- beer_necessities_hops_gathered %>% 
  filter(!is.na(hop_name)) %>% 
  filter(!hop_name == "")

beer_necessities_w_hops$hop_name <- factor(beer_necessities_w_hops$hop_name)

# For all hops, find the number of beers they're in as well as those beers' mean IBU and ABV
hops_beer_stats <- beer_necessities_w_hops %>% 
  ungroup() %>% 
  group_by(hop_name) %>% 
  summarise(
    mean_ibu = mean(ibu, na.rm = TRUE), 
    mean_abv = mean(abv, na.rm = TRUE),
    n = n()
  )

# Pare to hops that are used in at least 50 beers
pop_hops_beer_stats <- hops_beer_stats[hops_beer_stats$n > 50, ]
kable(pop_hops_beer_stats)

# Keep just beers that contain these most popular hops
beer_necessities_w_popular_hops <- beer_necessities_w_hops %>% 
  filter(hop_name %in% pop_hops_beer_stats$hop_name) %>% 
  droplevels() 

Are there certian hops that are used more often in very high IBU or ABV beers? Hard to detect a pattern

ggplot(data = beer_necessities_w_popular_hops) + 
  geom_point(aes(abv, ibu, colour = hop_name)) +
  ggtitle("Beers Containing most Popular Hops") +
  labs(x = "ABV", y = "IBU", colour = "Hop Name") +
  theme_minimal()
ggplot(data = pop_hops_beer_stats) + 
  geom_point(aes(mean_abv, mean_ibu, colour = hop_name, size = n)) +
  ggtitle("Most Popular Hops' Effect on Alcohol and Bitterness") +
  labs(x = "Mean ABV per Hop Type", y = "Mean IBU per Hop Type", colour = "Hop Name", 
       size = "Number of Beers") +
  theme_minimal()

Neural Net


library(nnet)
library(caret)

run_neural_net <- function(df, outcome, predictor_vars) {
  out <- list(outcome = outcome)
  
  # Create a new column outcome; it's style_collapsed if you set outcome to style_collapsed, and style otherwise
  if (outcome == "style_collapsed") {
    df[["outcome"]] <- df[["style_collapsed"]]
  } else {
    df[["outcome"]] <- df[["style"]]
  }

  df$outcome <- factor(df$outcome)
  
  cols_to_keep <- c("outcome", predictor_vars)
  
  df <- df %>%
    select_(.dots = cols_to_keep) %>%
    mutate(row = 1:nrow(df)) %>% 
    droplevels()

  # Select 80% of the data for training
  df_train <- sample_n(df, nrow(df)*(0.8))
  
  # The rest is for testing
  df_test <- df %>%
    filter(! (row %in% df_train$row)) %>%
    select(-row)
  
  df_train <- df_train %>%
    select(-row)
  
  # Build multinomail neural net
  nn <- multinom(outcome ~ .,
                 data = df_train, maxit=500, trace=FALSE)

  # Which variables are the most important in the neural net?
  most_important_vars <- varImp(nn)

  # How accurate is the model? Compare predictions to outcomes from test data
  nn_preds <- predict(nn, type="class", newdata = df_test)
  nn_accuracy <- postResample(df_test$outcome, nn_preds)

  out <- list(out, nn = nn, most_important_vars = most_important_vars,
              df_test = df_test,
              nn_preds = nn_preds,
           nn_accuracy = nn_accuracy)

  return(out)
}

Take out NAs

bt_omit <- beer_totals %>% na.omit()
p_vars <- c("total_hops", "total_malt", "abv", "ibu", "srm")

nn_collapsed_out <- run_neural_net(df = bt_omit, outcome = "style_collapsed", 
                         predictor_vars = p_vars)


# How accurate was it?
nn_collapsed_out$nn_accuracy

# What were the most important variables?
nn_collapsed_out$most_important_vars

nn_notcollapsed_out <- run_neural_net(df = bt_omit, outcome = "style", 
                         predictor_vars = p_vars)

nn_notcollapsed_out$nn_accuracy

nn_notcollapsed_out$most_important_vars

And now if we add glass as a predictor?


p_vars_add_glass <- c("total_hops", "total_malt", "abv", "ibu", "srm", "glass")

nn_collapsed_out_add_glass <- run_neural_net(df = beer_ingredients_join, outcome = "style_collapsed", 
                         predictor_vars = p_vars_add_glass)

nn_collapsed_out_add_glass$nn_accuracy

nn_collapsed_out_add_glass$most_important_vars

Random forest with all ingredients

  • We can use a random forest to get even more granular with ingredients
    • The sparse ingredient dataframe was too complex for the multinomial neural net but the ranger can handle sparse data like this
  • Here we don’t include glass as a predictor

library(ranger)
library(stringr)

bi <- beer_ingredients_join %>% 
  select(-c(id, name, style, hops_name, malt_name,
            # description,
            glass)) %>% 
  mutate(row = 1:nrow(.)) %>% 
  na.omit()

bi$style_collapsed <- factor(bi$style_collapsed)


# ranger complains about special characters and spaces in ingredient column names. Take them out and replace with empty string.
names(bi) <- tolower(names(bi))
names(bi) <- str_replace_all(names(bi), " ", "")
names(bi) <- str_replace_all(names(bi), "([\\(\\)-\\/')]+)", "")

# Keep 80% for training
bi_train <- sample_n(bi, nrow(bi)*(0.8))

# The rest is for testing
bi_test <- bi %>%
  filter(! (row %in% bi_train$row)) %>%
  dplyr::select(-row)

bi_train <- bi_train %>%
  dplyr::select(-row) %>% 
  select(-`#06300`)

bi_rf <- ranger(style_collapsed ~ ., data = bi_train, importance = "impurity", seed = 11)

OOB (out of bag) prediction error is around 58% * This calculated from tree samples constructed but not used in training set; these trees become effectively part of test set

bi_rf

We can compare predicted classification on the test set to their actual style classification.

pred_bi_rf <- predict(bi_rf, dat = bi_test)
# kable(table(bi_test$style_collapsed, pred_bi_rf$predictions))

Variable importance

  • Interestingly, ABV, IBU, and SRM are all much more important in the random forest than total_hops and total_malt

importance(bi_rf)[1:10]

How does a CSRF (case-specific random forest) fare?


bi_csrf <- csrf(style_collapsed ~ ., training_data = bi_train, test_data = bi_test,
                params1 = list(num.trees = 5, mtry = 4),
                params2 = list(num.trees = 2))

csrf_acc <- postResample(bi_csrf, bi_test$style_collapsed)

csrf_acc

Final Thoughts

Style first, forgiveness later?

  • One reason seems that beers are generally brewed with style in mind first (“let’s make a pale ale”) rather than deciding the beer’s style after determining its characteristics and idiosyncrasies
    • Even if the beer turns out more like a sour, and in a blind taste test might be classified as a sour more often than a pale ale, it still gets the label pale ale
    • This makes the style definitions broader and harder to predict

Future Directions

  • Hierarchical clustering
  • Incorporate flavor profiles for beers sourced/scraped from somewhere
  • Implement a GAN to come up with beer names
  • More on the hops deep dive: which hops are used most often in which styles?
sessionInfo()
LS0tCnRpdGxlOiBEYXRhIFNjaWVuY2UgTXVzaW5ncyBvbiBCZWVyCmF1dGhvcjoKICBuYW1lOiBBbWFuZGEgRG9iYnluCmRhdGU6ICdgciBmb3JtYXQoU3lzLnRpbWUoKSwgIiVCICVkLCAlWSIpYCcKIyBvdXRwdXQ6CiMgICBodG1sX25vdGVib29rOgojICAgICB0b2M6IGZhbHNlCiMgICAgIHRoZW1lOiB5ZXRpCiMgICBwZGZfZG9jdW1lbnQ6CiMgICAgIGtlZXBfdGV4OiB0cnVlCiMgICAgIHRvYzogZmFsc2UKIyAgIGdpdGh1Yl9kb2N1bWVudDoKIyAgICAgdG9jOiB0cnVlCiAgICAKb3V0cHV0OgogIGh0bWxfZG9jdW1lbnQ6CiAgICBrZWVwX21kOiB0cnVlCiAgICB0b2M6IGZhbHNlCiAgICB0aGVtZTogeWV0aQogIGdpdGh1Yl9kb2N1bWVudDoKICAgIHRvYzogdHJ1ZQotLS0KCmBgYHtyLCBldmFsPUZBTFNFLCBlY2hvPUZBTFNFfQojIElmIG5lZWQgdG8gY2xvc2UgYWxsIGNvbm5lY3Rpb25zCmxhcHBseSggZGJMaXN0Q29ubmVjdGlvbnMoIGRiRHJpdmVyKCBkcnYgPSAiTXlTUUwiKSksIGRiRGlzY29ubmVjdCkKYGBgCgpgYGB7ciBzZXR1cCwgaW5jbHVkZT1GQUxTRX0KbGlicmFyeShrbml0cikKCiMga25pdHI6Om9wdHNfa25pdCRzZXQocm9vdC5kaXI9bm9ybWFsaXplUGF0aCgnLi4vJykpCmtuaXRyOjpvcHRzX2NodW5rJHNldChlY2hvID0gRkFMU0UsIHdhcm5pbmcgPSBGQUxTRSkKa25pdHI6Om9wdHNfY2h1bmskc2V0KGZpZy53aWR0aD0xMiwgZmlnLmhlaWdodD04KSAKb3B0aW9ucyhrbml0ci50YWJsZS5mb3JtYXQgPSAnbWFya2Rvd24nKQpgYGAKCmBgYHtyLCBlY2hvPVRSVUUsIG1lc3NhZ2U9RkFMU0V9CnNvdXJjZSgiLi9yZWFkX2Zyb21fZGIuUiIpCmBgYAoKClRoaXMgaXMgYSBmaXJzdCBwYXNzIGV4cGxvcmF0aW9uIG9mIGRpZmZlcmVudCBhc3BlY3RzIG9mIGJlZXIuIFRoZSBkYXRhIHdhcyBjb2xsZWN0ZWQgdmlhIHRoZSBbQnJld2VyeURCXShodHRwOi8vd3d3LmJyZXdlcnlkYi5jb20vZGV2ZWxvcGVycykgQVBJLiBTcGVjaWFsIHRoYW5rcyB0byBbS3JpcyBLcm9za2ldKGh0dHBzOi8va3JvLnNraS8pIGZvciBkYXRhIGlkZWF0aW9uIGFuZCBjby1tZW1iZXJzaGlwIGluIHRoZSBob25vdXJhYmxlIHdvcmtwbGFjZSBiZWVyIGNvbnNvcnRpdW0uCgpUaGUgbWFpbiBxdWVzdGlvbiB0aGlzIGFuYWx5c2lzIGlzIG1lYW50IHRvIHRhY2tsZSBpczogQXJlIGJlZXIgc3R5bGVzIGFjdHVhbGx5IGluZGljYXRpdmUgb2Ygc2hhcmVkIGF0dHJpYnV0ZXMgb2YgdGhlIGJlZXJzIHdpdGhpbiB0aGF0IHN0eWxlPyBPciBhcmUgc3R5bGUgYm91bmRhcmllcyBtb3JlIG9yIGxlc3MgYXJiaXRyYXJ5PyBJIHRvb2sgdHdvIGFwcHJvYWNoZXMgdG8gdGhpczogdW5zdXBlcnZpc2VkIGNsdXN0ZXJpbmcgYW5kIHN1cGVydmlzZWQgcHJlZGljdGlvbi4gCgpDbHVzdGVycyBkZWZpbmVkIGJ5IHRoZSBhbGdvcml0aG0gd2VyZSBjb21wYXJlZCB0byB0aGUgc3R5bGUgImNlbnRlcnMiIGFzIGRlZmluZWQgYnkgdGhlIG1lYW4gQUJWLCBJQlUsIGFuZCBTUk0uIE9uIHRoZSBwcmVkaWN0aW9uIHNpZGUsIHByZWRpY3RvciB2YXJpYWJsZXMgZm9yIGluY2x1ZGUgQUJWIChhbGNvaG9sIGJ5IHZvbHVtZSksIElCVSAoaW50ZXJuYXRpb25hbCBiaXR0ZXJuZXNzIHVuaXRzKSwgU1JNIChbYSBtZWFzdXJlIG9mIGNvbG9yXShodHRwOi8vd3d3LnR3b2JlZXJkdWRlcy5jb20vYmVlci9zcm0pKSBhcyB3ZWxsIGFzIGluZ3JlZGllbnRzIGxpa2UgaG9wcyBhbmQgbWFsdHMuIFRoZSBvdXRjb21lIHZhcmlhYmxlIGlzIHRoZSBzdHlsZSB0aGF0IGJlZXIgd2FzIGFzc2lnbmVkLgoKVGhpcyBkb2N1bWVudCBzdGFydHMgb2ZmIHdpdGggYW4gZXhwbGFuYXRpb24gb2YgaG93IEkgc291cmNlZCBiZWVyIGRhdGEgZnJvbSBCcmV3ZXJ5REIsIGNsZWFuZWQgdGhhdCBkYXRhLCBhbmQgc3R1Y2sgdGhlIHBhcnRzIG9mIGl0IEkgd2FudGVkIGluIGEgZGF0YWJhc2UuIChUaGVzZSBhcmUganVzdCB0aGUgaGlnaGxpZ2h0czsgdGhlIGNvZGUgYWN0dWFsbHkgZXhlY3V0ZWQgaW4gdGhpcyBkb2N1bWVudCBxdWVyaWVzIHRoYXQgZGF0YWJhc2UsIHNwZWNpZmljYWxseSBieSBzb3VyY2luZyB0aGUgZmlsZSBgcmVhZF9mcm9tX2RiLlJgLCBhbHNvIGluIHRoaXMgcmVwbywgcmF0aGVyIHRoYW4gaGl0dGluZyB0aGUgQnJld2VyeURCIEFQSS4gVGhpcyBpcyBkb25lIGZvciBleHBlZGllbmN5J3Mgc2FrZSBhcyB0aGUgY29kZSBiZWxvdyBkZXRhaWxpbmcgaG93IHRvIGFjdHVhbGx5IGdldCB0aGUgYmVlciBkYXRhLCBydW4gaW4gZnVsbCBpbiBgcnVuX2l0LlJgLCB0YWtlcyBzb21lIHRpbWUgdG8gZXhlY3V0ZS4pCgpJdCB0aGVuIG1vdmVzIGludG8gY2x1c3RlcmluZyAoay1tZWFucykgYW5kIHByZWRpY3Rpb24gKG5ldXJhbCBuZXQsIHJhbmRvbSBmb3Jlc3QpLgogICAgICAgIApUaGUgYW5zd2VyIHRodXMgZmFyIHNlZW1zIHRvIGJlIHRoYXQgdGhlIGJlZXIgbGFuZHNjYXBlIGlzIG1vcmUgb2YgYSBzcGVjdHJ1bSB0aGFuIGEgY29sbGVjdGlvbiBvZiBuZWF0bHkgZGlmZmVyZW50aWF0ZWQgc3R5bGVzLiBCZWVyLWludHJpbnNpYyBhdHRyaWJ1dGVzIGxpa2UgYml0dGVybmVzcyBhcmVuJ3QgZ3JlYXQgcHJlZGljdG9ycyBvZiBzdHlsZS4gVGhlIHJlbGF0aXZlIGltcG9ydGFuY2Ugb2YgZGlmZmVyZW50IHZhcmlhYmxlcyBkZXBlZW5kcyBvbiB0aGUgcHJlZGljdGlvbiBtZXRob2QgdXNlZC4gSG93ZXZlciwgb25lIHN0eWxlLWRlZmluZWQgYXR0cmlidXRlLCB0aGUgZ2xhc3MgYSBiZWVyIGlzIHNlcnZlZCBpbiwgaW5jcmVhc2VkIHRoZSBhY2N1cmFjeSBvZiBwcmVkaWN0aW9uIHN1YnN0YW50aWFsbHkuCgpPZiBjb3Vyc2UsIG90aGVyIGltcG9ydGFudCBhc3BlY3RzIG9mIHRoZSBmbGF2b3IsIGJvZHksIHNtZWxsLCBldGMuIG9mIHRoZSBiZWVycyBjb3VsZCBub3QgYmUgY29uc2lkZXJlZCBiZWNhdXNlIHRoaXMgZGF0YSBpcyBub3QgYXZhaWxhYmxlIGZyb20gQnJld2VyeURCLgoKIVtdKC4vdGFwcy5qcGcpCgoKCiMjIyBXb3JrZmxvdyBPdmVydmlldwoKKipHZXQgYW5kIFByZXBhcmUqKgoKV2hlbiB3ZSBmaXJzdCBoaXQgdGhlIEJyZXdlcnlEQiBBUEkgdG8gaXRlcmF0aXZlbHkgcHVsbCBpbiBhbGwgYmVlcnMgYW5kIHRoZWlyIGluZ3JlZGllbnRzIGFsb25nIHdpdGggb3RoZXIgdGhpbmdzIHdlIG1pZ2h0IHdhbnQgbGlrZSBicmV3ZXJpZXMgYW5kIGdsYXNzd2FyZS4gVGhlbiB3ZSB1bm5lc3QgdGhlIEpTT04gcmVzcG9uc2VzLCBpbmNsdWRpbmcgYWxsIHRoZSBpbmdyZWRpZW50cyBjb2x1bW5zLCBhbmQgZHVtcCB0aGlzIGFsbCBpbnRvIGEgTXlTUUwgZGF0YWJhc2UuCgpOZXh0LCB3ZSBjcmVhdGUgYSBgc3R5bGVfY29sbGFwc2VkYCBjb2x1bW4gdG8gcmVkdWNlIHRoZSBudW1iZXIgb2YgbGV2ZWxzIG9mIG91ciBvdXRjb21lIHZhcmlhYmxlLiBXZSBkbyB0aGlzIGJ5IGBncmVwYGluZyB0aHJvdWdoIGVhY2ggYmVlcidzIHN0eWxlIHRvIGRldGVybWluZSBpZiB0aGF0IHN0eWxlIGNvbnRhaW5zIGEga2V5d29yZCB0aGF0IHF1YWxpZmllcyBpdCB0byBiZSByb2xsZWQgaW50byBhIGNvbGxhcHNlZCBzdHlsZTsgaWYgaXQgZG9lcywgaXQgZ2V0cyB0aGF0IGtleXdvcmQgaW4gYSBgc3R5bGVfY29sbGFwc2VkYCBjb2x1bW4uCgpGaW5hbGx5IHdlIHVubmVzdCB0aGUgaW5ncmVkaWVudHMgYGhvcHNgIGFuZCBgbWFsdHNgIGludG8gYSB3aWRlLCBzcGFyc2UgZGF0YWZyYW1lLiBJbmRpdmlkdWFsIGluZ3JlZGllbnRzIGFyZSBub3cgY29sdW1ucywgd2l0aCBlYWNoIGJlZXIgc3RpbGwgaW4gaXRzIG93biByb3dzOyBhIGNlbGwgZ2V0cyBhIDEgaWYgaW5ncmVkaWVudCBpcyBwcmVzZW50IGFuZCAwIG90aGVyd2lzZS4gVGhpcyBhbGxvd3MgbW9yZSBncmFudWFsIGluZmVyZW5jZSBpbnRvIGluZ3JlZGllbnRzJyBlZmZlY3RzIG9uIGJvdGggc3R5bGUgYW5kIGJpdHRlcm5lc3MgKG9jY2FzaW9uaW5nIGEgc2hvcnQgZm9yYXkgaW50byBob3BzKS4KCioqU2hvcnQgZm9yYXkgaW50byBob3BzKioKCkEgcXVpY2sgbG9vayBhdCB0aGUgbW9zdCBwb3B1bGFyIGhvcHMgYW5kIGFuIGV4cGxvcmF0aW9uIG9mIHRoZSByZWxhdGlvbnNoaXAgYmV0d2VlbiBob3BzIGFuZCBiaXR0ZXJuZXNzLgoKCioqSW5mZXIqKgoKQ2x1c3RlcjogdW5zdXBlcnZpc2VkIGstbWVhbnMgY2x1c3RlcmluZyBwYXJ0aXRpb25pbmcgdGhlIGVudGlyZSBkYXRhc2V0IGludG8gdGVuIGNsdXN0ZXJzLiBOZXh0LCB3ZSBjbHVzdGVyIG9uIGEgZGF0YXNldCBjb21wb3NlZCBvZiBqdXN0IGZpdmUgc2VsZWN0ZWQgc3R5bGVzIGludG8gZml2ZSBjbHVzdGVycy4gCgpXZSB0aGVuIGF0dGVtcHQgdG8gcHJlZGljdCBwcmVkaWN0IGVpdGhlciBgc3R5bGVgIG9yIGBzdHlsZV9jb2xsYXBzZWRgIHVzaW5nIGEgbmV1cmFsIG5ldCBhbmQgYSByYW5kb20gZm9yZXN0LiBUaGUgbWFpbiBwcmVkaWN0b3JzIGFyZSBBQlYsIElCVSwgU1JNLCB0b3RhbCBudW1iZXIgb2YgaG9wcywgYW5kIHRvdGFsIG51bWJlciBvZiBtYWx0cy4gVGhlIGdsYXNzIGEgYmVlciBpcyBzZXJ2ZWQgaW4gaXMgYWxzbyBjb25zaWRlcmVkLiBGaW5hbGx5LCAKCioqKgoKKipTaG9ydCBBc2lkZSoqCgpUaGUgcXVlc3Rpb24gb2Ygd2hhdCBzaG91bGQgYmUgYSBwcmVkaWN0b3IgdmFyaWFibGUgZm9yIHN0eWxlIGlzIGEgYml0IG11cmt5IGhlcmUuIFdoYXQgc2hvdWxkIGJlIGZhaXIgZ2FtZSBmb3IgcHJlZGljdGluZyBzdHlsZSBhbmQgd2hhdCBzaG91bGRuJ3Q/IENoYXJhY3RlcmlzdGljcyBvZiBhIGJlZXIgdGhhdCBhcmUgZGVmaW5lZCAqYnkqIGl0cyBzdHlsZSB3b3VsZCBzZWVtIHRvIGJlICJjaGVhdGluZyIgaW4gYSB3YXkuIFRoZSBvbmx5ICJpbnB1dHMiIHRvIGEgYmVlciB3ZSBoYXZlIGluIG91ciBkYXRhc2V0IGFyZSBpdHMgaW5ncmVkaWVudHMsIHByaW1hcmx5IGhvcHMgYW5kIG1hbHRzLiBXaGlsZSB0aGVzZSBjZXJ0YWlubHkgaGF2ZSBhbiBlZmZlY3Qgb24gaXRzIGZsYXZvciBwcm9maWxlLCBJIGNvbnNpZGVyIHRoZW0gc2VtaS1jaGVhdGluZyBiZWNhdXNlIGlmIHN0eWxlIGlzIGRldGVybWluZWQgYmVmb3JlaGFuZCBpdCBsaWtlbHkgZGV0ZXJtaW5lcyBhdCBsZWFzdCBpbiBwYXJ0IHdoaWNoIGluZ3JlZGllbnRzIGFyZSBhZGRlZC4gVGhlIG1haW4gY2FuZGlkYXRlcyBpbiBteSBtaW5kIGFyZSBBQlYsIElCVSwgYW5kIFNSTS4gVGhlc2UgYXJlICJvdXRwdXRzIiBvZiBhIGJlZXIgKGluIHRoZSBzZW5zZSB0aGF0IHRoZXkgY2FuIG9ubHkgYmUgZXhhY3RseSBkZXRlcm1pbmVkIG9uY2UgYSBiZWVyIGlzIGJyZXdlcmVkKSB0aGF0IG1lYW5pbmdmdWxseSBkZWZpbmUgaXQuIFdoaWxlIGNvcnJlbGF0ZWQgQUJWIGlzIGNvcnJlbGF0ZWQgd2l0aCBib3RoIElCVSBhbmQgU1JNLCB0aGUgdGhyZWUgYXJlIHRoZW9yZXRpY2FsbHkgb3J0aG9nb25hbCB0byBlYWNoIG90aGVyLiBBIHN0eWxlLWRlZmluZWQgYXR0cmlidXRlIGxpa2UgZ2xhc3MgdHlwZSBpcyBhIGJhZCBjYW5kaWRhdGUgZm9yIGEgcHJlZGljdG9yIHZhcmlhYmxlIGJlY2F1c2UgaXQgaXMgY29tcGxldGVseSBkZWNvdXBsZWQgZnJvbSB0aGUgYmVlciBpdHNlbGYgYW5kIGRldGVybWluZWQgZW50aXJlbHkgYnkgdGhlIHN0eWxlIHRoZSBiZWVyIGhhcyBiZWVuIGFzc2lnbmVkIHRvLgoKCgoKIyMjIEdldCBhbmQgUHJlcGFyZSBEYXRhCgoqKkdldHRpbmcgYmVlciwgdGhlIGFnZS1vbGQgZGlsZW1tYSoqCgoqIFRoZSBCcmV3ZXJ5REIgQVBJIHJldHVybnMgYSBjZXJ0YWluIG51bWJlciBvZiByZXN1bHRzIHBlciBwYWdlOyBpZiB3ZSB3YW50IAoqIFNvLCB3ZSBoaXQgdGhlIEJyZXdlcnlEQiBBUEkgYW5kIGFzayBmb3IgYDE6bnVtYmVyX29mX3BhZ2VzYAogICAgKiBXZSBjYW4gY2hhbmdlIGBudW1iZXJfb2ZfcGFnZXNgIHRvLCBlLmcuLCAzIGlmIHdlIG9ubHkgd2FudCB0aGUgZmlyc3QgMyBwYWdlcwogICAgKiBJZiB0aGVyZSdzIG9ubHkgb25lIHBhZ2UgKGFzIGlzIHRoZSBjYXNlIGZvciB0aGUgZ2xhc3N3YXJlIGVuZHBvaW50KSwgbnVtYmVyT2ZQYWdlcyB3b24ndCBiZSByZXR1cm5lZCwgc28gaW4gdGhpcyBjYXNlIHdlIHNldCBudW1iZXJfb2ZfcGFnZXMgdG8gMQoqIFRoZSBgYWRkaXRpb25gIHBhcmFtZXRlciBjYW4gYmUgYW4gZW1wdHkgc3RyaW5nIGlmIG5vdGhpbmcgZWxzZSBpcyBuZWVkZWQKCmBgYHtyLCBldmFsID0gRkFMU0UsIGVjaG89VFJVRX0KCmJhc2VfdXJsIDwtICJodHRwOi8vYXBpLmJyZXdlcnlkYi5jb20vdjIiCmtleV9wcmVmYWNlIDwtICIvP2tleT0iCgpwYWdpbmF0ZWRfcmVxdWVzdCA8LSBmdW5jdGlvbihlcCwgYWRkaXRpb24sIHRyYWNlX3Byb2dyZXNzID0gVFJVRSkgeyAgICAKICBmdWxsX3JlcXVlc3QgPC0gTlVMTAogIGZpcnN0X3BhZ2UgPC0gZnJvbUpTT04ocGFzdGUwKGJhc2VfdXJsLCAiLyIsIGVwLCAiLyIsIGtleV9wcmVmYWNlLCBrZXkKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAsICImcD0xIikpCiAgbnVtYmVyX29mX3BhZ2VzIDwtIGlmZWxzZSghKGlzLm51bGwoZmlyc3RfcGFnZSRudW1iZXJPZlBhZ2VzKSksIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgZmlyc3RfcGFnZSRudW1iZXJPZlBhZ2VzLCAxKSAgICAgIAoKICAgIGZvciAocGFnZSBpbiAxOm51bWJlcl9vZl9wYWdlcykgeyAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAKICAgIHRoaXNfcmVxdWVzdCA8LSBmcm9tSlNPTihwYXN0ZTAoYmFzZV91cmwsICIvIiwgZXAsICIvIiwga2V5X3ByZWZhY2UsIGtleQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAsICImcD0iLCBwYWdlLCBhZGRpdGlvbiksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmxhdHRlbiA9IFRSVUUpIAogICAgdGhpc19yZXFfdW5uZXN0ZWQgPC0gdW5uZXN0X2l0KHRoaXNfcmVxdWVzdCkgICAgIyAgPC0gcmVxdWVzdCB1bm5lc3RlZCBoZXJlCiAgICBpZih0cmFjZV9wcm9ncmVzcyA9PSBUUlVFKSB7bWVzc2FnZShwYXN0ZTAoIlBhZ2UgIiwgdGhpc19yZXFfdW5uZXN0ZWQkY3VycmVudFBhZ2UpKX0KICAgIGZ1bGxfcmVxdWVzdCA8LSBiaW5kX3Jvd3MoZnVsbF9yZXF1ZXN0LCB0aGlzX3JlcV91bm5lc3RlZFtbImRhdGEiXV0pCiAgfQogIHJldHVybihmdWxsX3JlcXVlc3QpCn0gCgphbGxfYmVlcl9yYXcgPC0gcGFnaW5hdGVkX3JlcXVlc3QoImJlZXJzIiwgIiZ3aXRoSW5ncmVkaWVudHM9WSIpCmBgYAoKCgoqIEZ1bmN0aW9uIGZvciB1bm5lc3RpbmcgSlNPTiB1c2VkIGluc2lkZSBgcGFnaW5hdGVkX3JlcXVlc3QoKWAgYmVsb3cKICAgICsgVGFrZXMgdGhlIGNvbHVtbiBuYW1lZCBgbmFtZWAgbmVzdGVkIHdpdGhpbiBhIGNvbHVtbiBpbiB0aGUgZGF0YSBwb3J0aW9uIG9mIHRoZSByZXNwb25zZQogICAgICAgICsgSWYgdGhlIGBuYW1lYCBjb2x1bW4gZG9lc24ndCBleGlzdCwgaXQgdGFrZXMgdGhlIGZpcnN0IG5lc3RlZCBjb2x1bW4KKiBXZSB1c2Ugc29tZXRoaW5nIHNpbWlsYXIgdG8gdW5uZXN0IGluZ3JlZGllbnQgbGlrZSBhbGwgb2YgYSBiZWVyJ3MgaG9wcyBhbmQgbWFsdHMgaW50byBhIGxvbmcgc3RyaW5nIGNvbnRhaW5lZCBpbiBgaG9wc19uYW1lYCBhbmQgYG1hbHRfbmFtZWAKCmBgYHtyLCBldmFsPUZBTFNFLCBlY2hvPVRSVUV9CnVubmVzdF9pdCA8LSBmdW5jdGlvbihkZikgewogIHVubmVzdGVkIDwtIGRmCiAgZm9yKGNvbCBpbiBzZXFfYWxvbmcoZGZbWyJkYXRhIl1dKSkgewogICAgaWYoISBpcy5udWxsKG5jb2woZGZbWyJkYXRhIl1dW1tjb2xdXSkpKSB7CiAgICAgIGlmKCEgaXMubnVsbChkZltbImRhdGEiXV1bW2NvbF1dW1sibmFtZSJdXSkpIHsKICAgICAgICB1bm5lc3RlZFtbImRhdGEiXV1bW2NvbF1dIDwtIGRmW1siZGF0YSJdXVtbY29sXV1bWyJuYW1lIl1dCiAgICAgIH0gZWxzZSB7CiAgICAgICAgdW5uZXN0ZWRbWyJkYXRhIl1dW1tjb2xdXSA8LSBkZltbImRhdGEiXV1bW2NvbF1dW1sxXV0KICAgICAgfQogICAgfQogIH0KICByZXR1cm4odW5uZXN0ZWQpCn0KYGBgCgoKCioqQ29sbGFwc2UgU3R5bGVzKioKCiogU2F2ZSB0aGUgbW9zdCBwb3B1bGFyIHN0eWxlcyBpbiBga2V5d29yZHNgCiogTG9vcCB0aHJvdWdoIGVhY2gga2V5d29yZAogICAgKiBGb3IgZWFjaCBiZWVyLCBgZ3JlcGAgdGhyb3VnaCBpdHMgc3R5bGUgY29sdW1uIHRvIHNlZSBpZiBpdCBjb250YWlucyBhbnkgb25lIG9mIHRoZXNlIGtleXdvcmRzCiAgICAqIElmIGl0IGRvZXMsIGdpdmUgaXQgdGhhdCBrZXl3b3JkIGluIGEgbmV3IGNvbHVtbiBgc3R5bGVfY29sbGFwc2VkYAoqIElmIGEgYmVlcidzIG5hbWUgbWF0Y2hlcyBtdWx0aXBsZSBrZXl3b3JkcywgZS5nLiwgQW1lcmljYW4gRG91YmxlIEluZGlhIFBhbGUgQWxlIHdvdWxkIG1hdGNoIERvdWJsZSBJbmRpYSBQYWxlIEFsZSwgSW5kaWEgUGFsZSBBbGUsIGFuZCBQYWxlIEFsZSwgaXRzIGBzdHlsZV9jb2xsYXBzZWRgIGlzIHRoZSAqKmxhc3QqKiBvZiB0aG9zZSB0aGF0IGFwcGVhciBpbiBrZXl3b3JkcyAKICAgICogVGhpcyBpcyB3aHkga2V5d29yZHMgYXJlIGludGVudGlvbmFsbHkgb3JkZXJlZCBmcm9tIG1vc3QgZ2VuZXJhbCB0byBtb3N0IHNwZWNpZmljCiAgICAqIFNvIGluIHRoZSBjYXNlIG9mIGFuIGNhc2Ugb2YgQW1lcmljYW4gRG91YmxlIEluZGlhIFBhbGUgQWxlOiBzaW5jZSBEb3VibGUgSW5kaWEgUGFsZSBBbGUgYXBwZWFycyBpbiBga2V5d29yZHNgIGFmdGVyIEluZGlhIFBhbGUgQWxlIGFuZCBQYWxlIEFsZSwgYW4gQW1lcmljYW4gRG91YmxlIEluZGlhIFBhbGUgQWxlIHdvdWxkIGdldCBhIGBzdHlsZV9jb2xsYXBzZWRgIG9mIERvdWJsZSBJbmRpYSBQYWxlIEFsZQoqIElmIG5vIGtleXdvcmQgaXMgY29udGFpbmVkIGluIGBzdHlsZWAsIGBzdHlsZV9jb2xsYXBzZWRgIGlzIGp1c3Qgd2hhdGV2ZXIncyBpbiBgc3R5bGVgOyBpbiBvdGhlciB3b3JkcywgaXQgZG9lc24ndCBnZXQgY29sbHBzZWQgaW50byBhIGJpZ2dlciBidWNrZXQKICAgICogVGhpcyBpc24ndCBhIGh1Z2UgcHJvYmxlbSBiZWNhdXNlIHdlJ2xsIHBhcmUgZG93biB0byBqdXN0IHRoZSBtb3N0IHBvcHVsYXIgc3R5bGVzIGxhdGVyLCBob3dldmVyIHdlIGNvdWxkIHRoaW5rIGFib3V0IGNyZWF0aW5nIGEgY2F0Y2hhbGwgIk90aGVyIiBsZXZlbCBmb3IgYHN0eWxlX2NvbGxhcHNlZGAKCmBgYHtyLCBldmFsPUZBTFNFLCBlY2hvPVRSVUV9CgoKa2V5d29yZHMgPC0gYygiTGFnZXIiLCAiUGFsZSBBbGUiLCAiSW5kaWEgUGFsZSBBbGUiLCAiRG91YmxlIEluZGlhIFBhbGUgQWxlIiwgIkluZGlhIFBhbGUgTGFnZXIiLCAiSGVmZXdlaXplbiIsICJCYXJyZWwtQWdlZCIsIldoZWF0IiwgIlBpbHNuZXIiLCAiUGlsc2VuZXIiLCAiQW1iZXIiLCAiR29sZGVuIiwgIkJsb25kZSIsICJCcm93biIsICJCbGFjayIsICJTdG91dCIsICJQb3J0ZXIiLCAiUmVkIiwgIlNvdXIiLCAiS8O2bHNjaCIsICJUcmlwZWwiLCAiQml0dGVyIiwgIlNhaXNvbiIsICJTdHJvbmcgQWxlIiwgIkJhcmxleSBXaW5lIiwgIkR1YmJlbCIsICJBbHRiaWVyIikKCmNvbGxhcHNlX3N0eWxlcyA8LSBmdW5jdGlvbihkZiwgdHJhY2VfcHJvZ3Jlc3MgPSBUUlVFKSB7CiAgCiAgZGZbWyJzdHlsZV9jb2xsYXBzZWQiXV0gPC0gdmVjdG9yKGxlbmd0aCA9IG5yb3coZGYpKQogIAogIGZvciAoYmVlciBpbiAxOm5yb3coZGYpKSB7CiAgICBpZiAoZ3JlcGwocGFzdGUoa2V5d29yZHMsIGNvbGxhcHNlPSJ8IiksIGRmJHN0eWxlW2JlZXJdKSkgeyAgICAKICAgICAgZm9yIChrZXl3b3JkIGluIGtleXdvcmRzKSB7ICAgICAgICAgCiAgICAgICAgaWYoZ3JlcGwoa2V5d29yZCwgZGYkc3R5bGVbYmVlcl0pID09IFRSVUUpIHsKICAgICAgICAgIGRmJHN0eWxlX2NvbGxhcHNlZFtiZWVyXSA8LSBrZXl3b3JkICAgIAogICAgICAgIH0gICAgICAgICAgICAgICAgICAgICAgICAgCiAgICAgIH0gCiAgICB9IGVsc2UgewogICAgICBkZiRzdHlsZV9jb2xsYXBzZWRbYmVlcl0gPC0gYXMuY2hhcmFjdGVyKGRmJHN0eWxlW2JlZXJdKSAgICAgICAKICAgIH0KICAgIGlmKHRyYWNlX3Byb2dyZXNzID09IFRSVUUpIHttZXNzYWdlKHBhc3RlMCgiQ29sbGFwc2luZyB0aGlzICIsIGRmJHN0eWxlW2JlZXJdLCAiIHRvOiAiLCBkZiRzdHlsZV9jb2xsYXBzZWRbYmVlcl0pKX0KICB9CiAgcmV0dXJuKGRmKQp9CgpgYGAKCiogVGhlbiB3ZSBjb2xsYXBzZSBmdXJ0aGVyOyByaWdodCBub3cgd2UganVzdCBjb21iaW5lIGFsbCB3aGVhdHkgYmVhcnMgaW50byBXaGVhdCBhbmQgUGlscy1saWtlIGJlZXJzIGludG8gUGlsc2VuZXIgKHdpdGggdHdvIGUncykgYnkgYGZjdF9jb2xsYXBzZWBpbmcgdGhvc2UgbGV2ZWxzCgpgYGB7ciwgZWNobz1UUlVFLCBldmFsPUZBTFNFfQpjb2xsYXBzZV9mdXJ0aGVyIDwtIGZ1bmN0aW9uKGRmKSB7CiAgZGZbWyJzdHlsZV9jb2xsYXBzZWQiXV0gPC0gZGZbWyJzdHlsZV9jb2xsYXBzZWQiXV0gJT4lCiAgICBmY3RfY29sbGFwc2UoCiAgICAgICJXaGVhdCIgPSBjKCJIZWZld2VpemVuIiwgIldoZWF0IiksCiAgICAgICJQaWxzZW5lciIgPSBjKCJQaWxzbmVyIiwgIkFtZXJpY2FuLVN0eWxlIFBpbHNlbmVyIikgIyBwaWxzZW5lciA9PSBwaWxzbmVyID09IHBpbHMKICAgICkKICByZXR1cm4oZGYpCn0KYGBgCgoKCioqU3BsaXQgb3V0IEluZ3JlZGllbnRzKioKCldoZW4gd2UgdW5uZXN0ZWQgaW5ncmVkaWVudHMsIHdlIGp1c3QgY29uY2F0ZW5hdGVkIGFsbCBvZiB0aGUgaW5ncmVkaWVudHMgZm9yIGEgZ2l2ZW4gYmVlciBpbnRvIGEgbG9uZyBzdHJpbmcuIElmIHdlIHdhbnQsIHdlIGNhbiBzcGxpdCBvdXQgdGhlIGluZ3JlZGllbnRzIHRoYXQgd2VyZSBjb25jYXRlbmF0ZWQgaW4gYDxpbmdyZWRpZW50Pl9uYW1lYCB3aXRoIHRoaXMgYHNwbGl0X2luZ3JlZGllbnRzYCBmdW5jdGlvbi4KClRoaXMgdGFrZXMgYSB2ZWN0b3Igb2YgYGluZ3JlZGllbnRzX3RvX3NwbGl0YCwgc28gZS5nLiBgYygiaG9wc19uYW1lIiwgIm1hbHRfbmFtZSIpYCBhbmQgY3JlYXRlcyBvbmUgY29sdW1uIGZvciBlYWNoIHR5cGUgb2YgaW5ncmVkaWVudCAoYGhvcHNfbmFtZV8xYCwgYGhvcHNfbmFtZV8yYCwgZXRjLikuIEl0J3MgZmxleGlibGUgZW5vdWdoIHRvIGFkYXB0IGlmIGRhdGEgaW4gQnJld2VyeURCIGNoYW5nZXMgYW5kIGEgYmVlciBub3cgaGFzIDE1IGhvcHMgd2hlcmUgYmVmb3JlIHRoZSBtYXhpbXVtIG51bWJlciBvZiBob3BzIGEgYmVlciBoYWQgd2FzIDEwLgoKYGBge3IsIGV2YWw9RkFMU0UsIGVjaG89VFJVRX0Kc3BsaXRfaW5ncmVkaWVudHMgPC0gZnVuY3Rpb24oZGYsIGluZ3JlZGllbnRzX3RvX3NwbGl0KSB7CiAgCiAgbmNvbF9kZiA8LSBuY29sKGRmKQogIAogIGZvciAoaW5ncmVkaWVudCBpbiBpbmdyZWRpZW50c190b19zcGxpdCkgewoKICAgIGluZ3JlZGllbnRfc3BsaXQgPC0gc3RyX3NwbGl0KGRmW1tpbmdyZWRpZW50XV0sICIsICIpICAgIAogICAgbnVtX25ld19jb2xzIDwtIG1heChsZW5ndGhzKGluZ3JlZGllbnRfc3BsaXQpKSAgICAKICAKICAgIGZvciAobnVtIGluIDE6bnVtX25ld19jb2xzKSB7CiAgICAgIAogICAgICB0aGlzX2NvbCA8LSBuY29sX2RmICsgMSAgICAgICAgIAogICAgICAKICAgICAgZGZbLCB0aGlzX2NvbF0gPC0gTkEKICAgICAgbmFtZXMoZGYpW3RoaXNfY29sXSA8LSBwYXN0ZTAoaW5ncmVkaWVudCwgIl8iLCBudW0pCiAgICAgIG5jb2xfZGYgPC0gbmNvbChkZikgICAgICAgICAgICAgCiAgICAgIGZvciAocm93IGluIHNlcV9hbG9uZyhpbmdyZWRpZW50X3NwbGl0KSkgeyAgICAgICAgICAKICAgICAgICBpZiAoIWlzLm51bGwoaW5ncmVkaWVudF9zcGxpdFtbcm93XV1bbnVtXSkpIHsgICAgICAgIAogICAgICAgICAgZGZbcm93LCB0aGlzX2NvbF0gPC0gaW5ncmVkaWVudF9zcGxpdFtbcm93XV1bbnVtXQogICAgICAgIH0KICAgICAgfQogICAgICBkZltbbmFtZXMoZGYpW3RoaXNfY29sXV1dIDwtIGZhY3RvcihkZltbbmFtZXMoZGYpW3RoaXNfY29sXV1dKQogICAgfQogICAgCiAgICBuY29sX2RmIDwtIG5jb2woZGYpCiAgfQogIHJldHVybihkZikKfQpgYGAKCgpTb21lIHF1aWNrIHN1bW1hcnkgc3RhdHMgb24gb3VyIG1haW4gZGF0YWZyYW1lIGNhbGxlZCBgYmVlcl9uZWNlc3NpdGllc2A6CmBgYHtyLCBlY2hvPVRSVUV9CmRpbShiZWVyX25lY2Vzc2l0aWVzKQpzdHIoYmVlcl9uZWNlc3NpdGllcykKYGBgCgoKKipGaW5kIHRoZSBNb3N0IFBvcHVhbGFyIFN0eWxlcyoqCgpXZSBmaW5kIG1lYW4gQUJWLCBJQlUsIGFuZCBTUk0gcGVyIGNvbGxhcHNlZCBzdHlsZSBhbmQgYXJyYW5nZSBjb2xsYXBzZWQgc3R5bGVzIGJ5IHRoZSBudW1iZXIgb2YgYmVlcnMgdGhhdCBmYWxsIGludG8gdGhlbS4gKFRoaXMgaXMgb2YgY291cnNlIGRlcGVuZGVudCBvbiBob3cgd2UgY29sbGFwc2Ugc3R5bGVzOyBpZiB3ZSBsb29wZWQgYWxsIERvdWJsZSBJUEFzIGluIHdpdGggSVBBcyB0aGVuIHRoZSBjYXRlZ29yeSBJUEEgd291bGQgYmUgbXVjaCBiaWdnZXIgdGhhbiBpdCBpcyBpZiB3ZSBrZWVwIHRoZSB0d28gc2VwYXJhdGUuKQoKYGBge3IsIGV2YWw9VFJVRSwgZWNobz1UUlVFfQpsaWJyYXJ5KGZvcmNhdHMpCgojIFBhcmUgZG93biB0byBvbmx5IGNhc2VzIHdoZXJlIHN0eWxlIGlzIG5vdCBOQQpiZWVyX2RhdF9wYXJlZCA8LSBiZWVyX25lY2Vzc2l0aWVzW2NvbXBsZXRlLmNhc2VzKGJlZXJfbmVjZXNzaXRpZXMkc3R5bGUpLCBdCgojIEFycmFuZ2UgYmVlciBkYXQgYnkgc3R5bGUgcG9wdWxhcml0eQpzdHlsZV9wb3B1bGFyaXR5IDwtIGJlZXJfZGF0X3BhcmVkICU+JSAKICBncm91cF9ieShzdHlsZSkgJT4lIAogIGNvdW50KCkgJT4lIAogIGFycmFuZ2UoZGVzYyhuKSkKCiMgQWRkIGEgY29sdW1uIHRoYXQgc2NhbGVzIHBvcHVsYXJpdHkKc3R5bGVfcG9wdWxhcml0eSA8LSBiaW5kX2NvbHMoc3R5bGVfcG9wdWxhcml0eSwgCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBuX3NjYWxlZCA9IGFzLnZlY3RvcihzY2FsZShzdHlsZV9wb3B1bGFyaXR5JG4pKSkKCiMgRmluZCBzdHlsZXMgdGhhdCBhcmUgYWJvdmUgYSB6LXNjb3JlIG9mIDAKcG9wdWxhcl9zdHlsZXMgPC0gc3R5bGVfcG9wdWxhcml0eSAlPiUgCiAgZmlsdGVyKG5fc2NhbGVkID4gMCkKCiMgUGFyZSBkYXQgZG93biB0byBvbmx5IGJlZXJzIHRoYXQgZmFsbCBpbnRvIHRob3NlIHN0eWxlcwpwb3B1bGFyX2JlZXJfZGF0IDwtIGJlZXJfZGF0X3BhcmVkICU+JSAKICBmaWx0ZXIoCiAgICBzdHlsZSAlaW4lIHBvcHVsYXJfc3R5bGVzJHN0eWxlCiAgKSAlPiUgCiAgZHJvcGxldmVscygpICU+JSAKICBhc190aWJibGUoKSAKYGBgCgoKSG93IG1hbnkgcm93cyBkbyB3ZSBoYXZlIGluIG91ciBkYXRhc2V0IG9mIGp1c3QgYmVlcnMgdGhhdCBmYWxsIGludG8gdGhlIHBvcHVsYXIgc3R5bGVzPwpgYGB7ciwgZWNobz1UUlVFfQpucm93KHBvcHVsYXJfYmVlcl9kYXQpCmBgYAoKCk5vdyB3ZSBmaW5kIHRoZSBzdHlsZSBjZW50ZXJzLgpgYGB7ciwgZWNobz1UUlVFfQojIEZpbmQgdGhlIGNlbnRlcnMgKG1lYW4gYWJ2LCBpYnUsIHNybSkgb2YgdGhlIG1vc3QgcG9wdWxhciBzdHlsZXMKc3R5bGVfY2VudGVycyA8LSBwb3B1bGFyX2JlZXJfZGF0ICU+JSAKICBncm91cF9ieShzdHlsZV9jb2xsYXBzZWQpICU+JSAKICBhZGRfY291bnQoKSAlPiUgCiAgc3VtbWFyaXNlKAogICAgbWVhbl9hYnYgPSBtZWFuKGFidiwgbmEucm0gPSBUUlVFKSwKICAgIG1lYW5faWJ1ID0gbWVhbihpYnUsIG5hLnJtID0gVFJVRSksIAogICAgbWVhbl9zcm0gPSBtZWFuKHNybSwgbmEucm0gPSBUUlVFKSwKICAgIG4gPSBtZWRpYW4obiwgbmEucm0gPSBUUlVFKSAgICAgICAgICAjIE1lZGlhbiBoZXJlIG9ubHkgZm9yIHN1bW1hcmlzZS4gU2hvdWxkIGJlIGp1c3QgdGhlIHNhbWUgYXMgbgogICkgJT4lIAogIGFycmFuZ2UoZGVzYyhuKSkgJT4lIAogIGRyb3BfbmEoKSAlPiUgCiAgZHJvcGxldmVscygpCgojIEdpdmUgc29tZSBuaWNlciBuYW1lcwpzdHlsZV9jZW50ZXJzX3JlbmFtZSA8LSBzdHlsZV9jZW50ZXJzICU+JSAKICByZW5hbWUoCiAgICBgQ29sbGFwc2VkIFN0eWxlYCA9IHN0eWxlX2NvbGxhcHNlZCwKICAgIGBNZWFuIEFCVmAgPSBtZWFuX2FidiwKICAgIGBNZWFuIElCVWAgPSBtZWFuX2lidSwKICAgIGBNZWFuIFNSTWAgPSBtZWFuX3NybSwKICAgIGBOdW1lciBvZiBCZWVyc2AgPSBuCiAgKQpgYGAKCgpUYWtlIGEgbG9vayBhdCB0aGUgdGFibGUsIG9yZGVyZWQgYnkgbnVtYmVyIG9mIGJlZXJzIGluIHRoYXQgc3R5bGUsIGRlc2NlbmRpbmcuICAgICAgCgpgYGB7cn0Ka2FibGUoc3R5bGVfY2VudGVyc19yZW5hbWUpCmBgYAoKCgoqKioKCiMjIyBJbmdyZWRpZW50cwoKVG8gZ2V0IG1vcmUgZ3JhbnVsYXIgd2l0aCBpbmdyZWRpZW50cywgd2UgY2FuIHNwbGl0IG91dCBlYWNoIGluZGl2aWR1YWwgaW5ncmVkaWVudCBpbnRvIGl0cyBvd24gY29sdW1uLiBJZiBhIGJlZXIgb3Igc3R5bGUgY29udGFpbnMgdGhhdCBpbmdyZWRpZW50LCBpdHMgcm93IGdldHMgYSAxIGluIHRoYXQgaW5ncmVkaWVudCBjb2x1bW4gYW5kIGEgMCBvdGhlcndpc2UuCgpGcm9tIHRoaXMsIHdlIGNhbiBmaW5kIHRoZSB0b3RhbCBudW1iZXIgb2YgaG9wcyBhbmQgbWFsdHMgcGVyIGdyb3VwZXIuCgoqIFRoZSBkYXRhZnJhbWUgd2UnbGwgdXNlIHdpbGwgYmUgYGJlZXJfbmVjZXNzaXRpZXNgCgoKCiogVGhpcyBmdW5jdGlvbiB0YWtlcyBhIGRhdGFmcmFtZSBhbmQgdHdvIG90aGVyIHBhcmFtZXRlcnMgc2V0IGF0IHRoZSBvdXRzZXQ6CiAgICAqIGBpbmdyZWRpZW50X3dhbnRgOiB0aGlzIGNhbiBiZSBgaG9wc2AsIGBtYWx0YCwgb3Igb3RoZXIgaW5ncmVkaWVudHMgbGlrZSBgeWVhc3RgIGlmIHdlIHB1bGwgdGhhdCBpbgogICAgKiBgZ3JvdXBlcmA6IGNhbiBiZSBhIHZlY3RvciBvZiBvbmUgb3IgbW9yZSB0aGluZ3MgdG8gZ3JvdXAgYnksIGxpa2UgYmVlciBgbmFtZWAgb3IgYHN0eWxlYAoKYGBge3IsIGV2YWw9VFJVRSwgZWNobz1UUlVFfQoKcGlja19pbmdyZWRpZW50X2dldF9iZWVyIDwtIGZ1bmN0aW9uIChpbmdyZWRpZW50X3dhbnQsIGRmLCBncm91cGVyKSB7CiAgCiAgIyAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLSBTZXR1cCAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0gIwogICMgV2UndmUgYWxyZWFkeSBzcGxpdCBpbmdyZWRpZW50IG51bWJlciBuYW1lcyBvdXQgZnJvbSB0aGUgY29uY2F0ZW5hdGVkIHN0cmluZyBpbnRvIGNvbHVtbnMgbGlrZSBgbWFsdF9uYW1lXzFgLAogICMgYG1hbHRfbmFtZV8yYCwgZXRjLiBXZSBuZWVkIHRvIGZpbmQgdGhlIHJhbmdlIG9mIHRoZXNlIGNvbHVtbnM7IHRoZXJlIHdpbGwgYmUgYSBkaWZmZXJlbnQgbnVtYmVyIG9mIG1hbHQKICAjIGNvbHVtbnMgdGhhbiBob3BzIGNvbHVtbnMsIGZvciBpbnN0YW5jZS4gVGhlIGZpcnN0IG9uZSB3aWxsIGJlIGA8aW5ncmVkaWVudD5fbmFtZV8xYCBhbmQgZnJvbSB0aGlzIHdlIGNhbiBmaW5kCiAgIyB0aGUgaW5kZXggb2YgdGhpcyBjb2x1bW4gaW4gb3VyIGRhdGFmcmFtZS4gV2UgZ2V0IHRoZSBuYW1lIG9mIGxhc3Qgb25lIHdpdGggdGhlIGBnZXRfbGFzdF9pbmdfbmFtZV9jb2woKWAKICAjIGZ1bmN0aW9uLiBUaGVuIHdlIHNhdmUgYSB2ZWN0b3Igb2YgYWxsIHRoZSBpbmdyZWRpZW50IGNvbHVtbiBuYW1lcyBpbiBgaW5ncmVkaWVudF9jb2xuYW1lc2AuIEl0IHdpbGwgc3RheQogICMgY29uc3RhbnQgZXZlbiBpZiB0aGUgaW5kaWNlcyBjaGFuZ2Ugd2hlbiB3ZSBzZWxlY3Qgb3V0IGNlcnRhaW4gY29sdW1ucy4gCiAgCiAgIyBGaXJzdCBpbmdyZWRpZW50CiAgZmlyc3RfaW5ncmVkaWVudF9uYW1lIDwtIHBhc3RlKGluZ3JlZGllbnRfd2FudCwgIl9uYW1lXzEiLCBzZXA9IiIpCiAgZmlyc3RfaW5ncmVkaWVudF9pbmRleCA8LSB3aGljaChjb2xuYW1lcyhkZik9PWZpcnN0X2luZ3JlZGllbnRfbmFtZSkKICAKICAjIEdldCB0aGUgbGFzdCBpbmdyZWRpZW50CiAgZ2V0X2xhc3RfaW5nX25hbWVfY29sIDwtIGZ1bmN0aW9uKGRmKSB7CiAgICBmb3IgKGNvbCBpbiBuYW1lcyhkZikpIHsKICAgICAgaWYgKGdyZXBsKHBhc3RlKGluZ3JlZGllbnRfd2FudCwgIl9uYW1lXyIsIHNlcCA9ICIiKSwgY29sKSA9PSBUUlVFKSB7CiAgICAgICAgbmFtZV9sYXN0X2luZ19jb2wgPC0gY29sCiAgICAgIH0KICAgIH0KICAgIHJldHVybihuYW1lX2xhc3RfaW5nX2NvbCkKICB9CiAgCiAgIyBMYXN0IGluZ3JlZGllbnQKICBsYXN0X2luZ3JlZGllbnRfbmFtZSA8LSBnZXRfbGFzdF9pbmdfbmFtZV9jb2woZGYpCiAgbGFzdF9pbmdyZWRpZW50X2luZGV4IDwtIHdoaWNoKGNvbG5hbWVzKGRmKT09bGFzdF9pbmdyZWRpZW50X25hbWUpCiAgCiAgIyBWZWN0b3Igb2YgYWxsIHRoZSBpbmdyZWRpZW50IGNvbHVtbiBuYW1lcwogIGluZ3JlZGllbnRfY29sbmFtZXMgPC0gbmFtZXMoZGYpW2ZpcnN0X2luZ3JlZGllbnRfaW5kZXg6bGFzdF9pbmdyZWRpZW50X2luZGV4XQogIAogICMgTm9uLWluZ3JlZGllbnQgY29sdW1uIG5hbWVzIHdlIHdhbnQgdG8ga2VlcAogIHRvX2tlZXBfY29sX25hbWVzIDwtIGMoImlkIiwgImNsdXN0ZXJfYXNzaWdubWVudCIsICJuYW1lIiwgImFidiIsICJpYnUiLCAic3JtIiwgInN0eWxlIiwgInN0eWxlX2NvbGxhcHNlZCIpCiAgCiAgIyAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tIyAKICAKICAjIEluc2lkZSBgZ2F0aGVyX2luZ3JlZGllbnRzKClgIHdlIHRha2Ugb3V0IHN1cGVyZmxvdXMgY29sdW1uIG5hbWVzIHRoYXQgYXJlIG5vdCBpbiBgdG9fa2VlcF9jb2xfbmFtZXNgIG9yIG9uZSAKICAjIG9mIHRoZSBpbmdyZWRpZW50IGNvbHVtbnMsIGZpbmQgd2hhdCB0aGUgbmV3IGluZ3JlZGllbnQgY29sdW1uIGluZGljZXMgYXJlLCBzaW5jZSB0aGV5J2xsIGhhdmUgY2hhbmdlZCBhZnRlciAKICAjIHdlIHBhcmVkIGRvd24gYW5kIHRoZW4gZ2F0aGVyIGFsbCBvZiB0aGUgaW5ncmVkaWVudCBjb2x1bW5zIChlLmcuLCBgaG9wc19uYW1lXzFgKSBpbnRvIG9uZSBsb25nIGNvbHVtbiwgCiAgIyBgaW5nX2tleXNgIGFuZCBhbGwgdGhlIGFjdHVhbCBpbmdyZWRpZW50IG5hbWVzIChlLmcuLCBDYXNjYWRlKSBpbnRvIGBpbmdfbmFtZXNgLgogIAogICMgLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0gR2F0aGVyIGNvbHVtbnMgLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tICMKICBnYXRoZXJfaW5ncmVkaWVudHMgPC0gZnVuY3Rpb24oZGYsIGNvbHNfdG9fZ2F0aGVyKSB7CiAgICB0b19rZWVwX2luZGljZXMgPC0gd2hpY2goY29sbmFtZXMoZGYpICVpbiUgdG9fa2VlcF9jb2xfbmFtZXMpCiAgICAKICAgIHNlbGVjdGVkX2RmIDwtIGRmWywgYyh0b19rZWVwX2luZGljZXMsIGZpcnN0X2luZ3JlZGllbnRfaW5kZXg6bGFzdF9pbmdyZWRpZW50X2luZGV4KV0KICAgIAogICAgbmV3X2luZ19pbmRpY2VzIDwtIHdoaWNoKGNvbG5hbWVzKHNlbGVjdGVkX2RmKSAlaW4lIGNvbHNfdG9fZ2F0aGVyKSAgICAjIGluZGljZXMgd2lsbCBoYXZlIGNoYW5nZWQgc2luY2Ugd2UgcGFyZWQgZG93biAKICAgIAogICAgZGZfZ2F0aGVyZWQgPC0gc2VsZWN0ZWRfZGYgJT4lCiAgICAgIGdhdGhlcl8oCiAgICAgICAga2V5X2NvbCA9ICJpbmdfa2V5cyIsCiAgICAgICAgdmFsdWVfY29sID0gImluZ19uYW1lcyIsCiAgICAgICAgZ2F0aGVyX2NvbHMgPSBjb2xuYW1lcyhzZWxlY3RlZF9kZilbbmV3X2luZ19pbmRpY2VzXQogICAgICApICU+JQogICAgICBtdXRhdGUoCiAgICAgICAgY291bnQgPSAxCiAgICAgICkKICAgIHJldHVybihkZl9nYXRoZXJlZCkKICB9CiAgYmVlcl9nYXRoZXJlZCA8LSBnYXRoZXJfaW5ncmVkaWVudHMoZGYsIGluZ3JlZGllbnRfY29sbmFtZXMpICAjIGluZ3JlZGllbnQgY29sbmFtZXMgZGVmaW5lZCBhYm92ZSBmdW5jdGlvbgogICMgLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLSAjIAogIAogICMgTmV4dCB3ZSBnZXQgYSB2ZWN0b3Igb2YgYWxsIGluZ3JlZGllbnQgbGV2ZWxzIGFuZCB0YWtlIG91dCB0aGUgb25lIHRoYXQncyBhbiBlbXB0eSBzdHJpbmcgYW5kIAogICMgdXNlIHRoaXMgdmVjdG9yIG9mIGluZ3JlZGllbnQgbGV2ZWxzIGluIGBzZWxlY3Rfc3ByZWFkX2NvbHMoKWAgYmVsb3cKCiAgIyBHZXQgYSB2ZWN0b3Igb2YgYWxsIGluZ3JlZGllbnQgbGV2ZWxzCiAgYmVlcl9nYXRoZXJlZCRpbmdfbmFtZXMgPC0gZmFjdG9yKGJlZXJfZ2F0aGVyZWQkaW5nX25hbWVzKQogIGluZ3JlZGllbnRfbGV2ZWxzIDwtIGxldmVscyhiZWVyX2dhdGhlcmVkJGluZ19uYW1lcykgCiAgCiAgIyBUYWtlIG91dCB0aGUgbGV2ZWwgdGhhdCdzIGp1c3QgYW4gZW1wdHkgc3RyaW5nCiAgdG9fa2VlcF9sZXZlbHMgPC0gIShjKDE6bGVuZ3RoKGluZ3JlZGllbnRfbGV2ZWxzKSkgJWluJSB3aGljaChpbmdyZWRpZW50X2xldmVscyA9PSAiIikpCiAgaW5ncmVkaWVudF9sZXZlbHMgPC0gaW5ncmVkaWVudF9sZXZlbHNbdG9fa2VlcF9sZXZlbHNdCiAgCiAgYmVlcl9nYXRoZXJlZCRpbmdfbmFtZXMgPC0gYXMuY2hhcmFjdGVyKGJlZXJfZ2F0aGVyZWQkaW5nX25hbWVzKQogIAogICMgLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0gIyAKICAKICAjIFRoZW4gd2Ugc3ByZWFkIHRoZSBpbmdyZWRpZW50IG5hbWVzOiB3ZSB0YWtlIHdoYXQgd2FzIHByZXZpb3VzbHkgdGhlIGB2YWx1ZWAgaW4gb3VyIGdhdGhlcmVkIGRhdGFmcmFtZSwgdGhlCiAgIyBhY3R1YWwgaW5ncmVkaWVudCBuYW1lcyAoQ2FzY2FkZSwgQ2VudGVubmlhbCkgYW5kIG1ha2UgdGhhdCBvdXIgYGtleWA7IGl0J2xsIGZvcm0gdGhlIG5ldyBjb2x1bW4gbmFtZXMuIFRoZQogICMgbmV3IGB2YWx1ZWAgaXMgYHZhbHVlYCBpcyBjb3VudDsgaXQnbGwgcG9wdWxhdGUgdGhlIHJvdyBjZWxscy4gSWYgYSBnaXZlbiByb3cgaGFzIGEgY2VydGFpbiBpbmdyZWRpZW50LCBpdAogICMgZ2V0cyBhIDEgaW4gdGhlIGNvcnJlc3BvbmRpbmcgY2VsbCwgYW4gTkEgb3RoZXJ3aXNlLiAKICAjIFdlIGFkZCBhIHVuaXF1ZSBpZGVuZml0aWVyIGZvciBlYWNoIHJvdyB3aXRoIGByb3dgLCB3aGljaCB3ZSdsbCBkcm9wIGxhdGVyIChzZWUgW0hhZGxleSdzIFNPCiAgIyBjb21tZW50XShodHRwczovL3N0YWNrb3ZlcmZsb3cuY29tL3F1ZXN0aW9ucy8yNTk2MDM5NC91bmV4cGVjdGVkLWJlaGF2aW9yLXdpdGgtdGlkeXIpKS4KCiAgCiAgIyAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tIFNwcmVhZCBjb2x1bW5zIC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tICMKICBzcHJlYWRfaW5ncmVkaWVudHMgPC0gZnVuY3Rpb24oZGYpIHsKICAgIGRmX3NwcmVhZCA8LSBkZiAlPiUgCiAgICAgIG11dGF0ZSgKICAgICAgICByb3cgPSAxOm5yb3coZGYpICAgICAgICAjIEFkZCBhIHVuaXF1ZSBpZGVuZml0aWVyIGZvciBlYWNoIHJvdyB3aGljaCB3ZSdsbCBuZWVkIGluIG9yZGVyIHRvIHNwcmVhZDsgd2UnbGwgZHJvcCB0aGlzIGxhdGVyCiAgICAgICkgJT4lICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgCiAgICAgIHNwcmVhZCgKICAgICAgICBrZXkgPSBpbmdfbmFtZXMsCiAgICAgICAgdmFsdWUgPSBjb3VudAogICAgICApIAogICAgcmV0dXJuKGRmX3NwcmVhZCkKICB9CiAgYmVlcl9zcHJlYWQgPC0gc3ByZWFkX2luZ3JlZGllbnRzKGJlZXJfZ2F0aGVyZWQpCiAgIyAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tICMgCgogIAogICMgLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLSBTZWxlY3Qgb25seSBjZXJ0YWluIGNvbHVtbnMgLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLSAjCiAgc2VsZWN0X3NwcmVhZF9jb2xzIDwtIGZ1bmN0aW9uKGRmKSB7CiAgICB0b19rZWVwX2NvbF9pbmRpY2VzIDwtIHdoaWNoKGNvbG5hbWVzKGRmKSAlaW4lIHRvX2tlZXBfY29sX25hbWVzKQogICAgdG9fa2VlcF9pbmdyZWRpZW50X2luZGljZXMgPC0gd2hpY2goY29sbmFtZXMoZGYpICVpbiUgaW5ncmVkaWVudF9sZXZlbHMpCiAgICAKICAgIHRvX2tlZXBfaW5kc19hbGwgPC0gYyh0b19rZWVwX2NvbF9pbmRpY2VzLCB0b19rZWVwX2luZ3JlZGllbnRfaW5kaWNlcykKICAgIAogICAgbmV3X2RmIDwtIGRmICU+JSAKICAgICAgc2VsZWN0XygKICAgICAgICAuZG90cyA9IHRvX2tlZXBfaW5kc19hbGwKICAgICAgKQogICAgcmV0dXJuKG5ld19kZikKICB9CiAgYmVlcl9zcHJlYWRfc2VsZWN0ZWQgPC0gc2VsZWN0X3NwcmVhZF9jb2xzKGJlZXJfc3ByZWFkKQogICMgLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLSAjIAoKICAjIFRha2Ugb3V0IGFsbCByb3dzIHRoYXQgaGF2ZSBubyBpbmdyZWRpZW50cyBzcGVjaWZpZWQgYXQgYWxsCiAgaW5kc190b19yZW1vdmUgPC0gYXBwbHkoYmVlcl9zcHJlYWRfc2VsZWN0ZWRbLCBmaXJzdF9pbmdyZWRpZW50X2luZGV4Omxhc3RfaW5ncmVkaWVudF9pbmRleF0sIAogICAgICAgICAgICAgICAgICAgICAgICAgIDEsIGZ1bmN0aW9uKHgpIGFsbChpcy5uYSh4KSkpCiAgYmVlcl9zcHJlYWRfbm9fbmEgPC0gYmVlcl9zcHJlYWRfc2VsZWN0ZWRbICFpbmRzX3RvX3JlbW92ZSwgXQogIAogIAogICMgLS0tLS0tLS0tLS0tLS0tLS0gR3JvdXAgaW5ncmVkaWVudHMgYnkgdGhlIGdyb3VwZXIgc3BlY2lmaWVkIC0tLS0tLS0tLS0tLS0tLS0tLS0gIwogICMgVGhlbiB3ZSBkbyB0aGUgZmluYWwgc3RlcCBhbmQgZ3JvdXAgYnkgdGhlIGdyb3VwZXJzLgogIAogIGdldF9pbmdyZWRpZW50c19wZXJfZ3JvdXBlciA8LSBmdW5jdGlvbihkZiwgZ3JvdXBlciA9IGdyb3VwZXIpIHsKICAgIGRmX2dyb3VwZWQgPC0gZGYgJT4lCiAgICAgIHVuZ3JvdXAoKSAlPiUgCiAgICAgIGdyb3VwX2J5Xyhncm91cGVyKQogICAgCiAgICBub3RfZm9yX3N1bW1pbmcgPC0gd2hpY2goY29sbmFtZXMoZGZfZ3JvdXBlZCkgJWluJSB0b19rZWVwX2NvbF9uYW1lcykKICAgIG1heF9ub3RfZm9yX3N1bW1pbmcgPC0gbWF4KG5vdF9mb3Jfc3VtbWluZykKICAgIAogICAgYnJvd3NlcigpCiAgICBwZXJfZ3JvdXBlciA8LSBkZl9ncm91cGVkICU+JSAKICAgICAgc2VsZWN0KC1jKGFidiwgaWJ1LCBzcm0pKSAlPiUgICAgIyB0YWtpbmcgb3V0IHRlbXBvcmFyaWx5CiAgICAgIHN1bW1hcmlzZV9pZigKICAgICAgICBpcy5udW1lcmljLCAgICAgICAgICAgICAgCiAgICAgICAgc3VtLCBuYS5ybSA9IFRSVUUKICAgICAgICAjIC1jKGFidiwgaWJ1LCBzcm0pCiAgICAgICkgJT4lCiAgICAgIG11dGF0ZSgKICAgICAgICB0b3RhbCA9IHJvd1N1bXMoLlsobWF4X25vdF9mb3Jfc3VtbWluZyArIDEpOm5jb2woLildLCBuYS5ybSA9IFRSVUUpICAgIAogICAgICApCiAgICAKICAgICMgU2VuZCB0b3RhbCB0byB0aGUgc2Vjb25kIHBvc2l0aW9uCiAgICBwZXJfZ3JvdXBlciA8LSBwZXJfZ3JvdXBlciAlPiUgCiAgICAgIHNlbGVjdCgKICAgICAgICBpZCwgdG90YWwsIGV2ZXJ5dGhpbmcoKQogICAgICApCiAgICAKICAgICMgUmVwbGFjZSB0b3RhbCBjb2x1bW4gd2l0aCBtb3JlIGRlc2NyaXB0aXZlIG5hbWU6IHRvdGFsXzxpbmdyZWRpZW50PgogICAgbmFtZXMocGVyX2dyb3VwZXIpW3doaWNoKG5hbWVzKHBlcl9ncm91cGVyKSA9PSAidG90YWwiKV0gPC0gcGFzdGUwKCJ0b3RhbF8iLCBpbmdyZWRpZW50X3dhbnQpCiAgICAKICAgIHJldHVybihwZXJfZ3JvdXBlcikKICB9CiAgIyAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tICMgCiAgCiAgaW5ncmVkaWVudHNfcGVyX2dyb3VwZXIgPC0gZ2V0X2luZ3JlZGllbnRzX3Blcl9ncm91cGVyKGJlZXJfc3ByZWFkX3NlbGVjdGVkLCBncm91cGVyKQogIHJldHVybihpbmdyZWRpZW50c19wZXJfZ3JvdXBlcikKfQpgYGAKCgoqIE5vdyBydW4gdGhlIGZ1bmN0aW9uIHdpdGggYGluZ3JlZGllbnRfd2FudGAgYXMgZmlyc3QgaG9wcywgdGhlbiBtYWx0CiogVGhlbiBqb2luIHRoZSByZXN1bHRpbmcgZGF0YWZyYW1lcyBhbmQgcmVtb3ZlL3Jlb3JkZXIgc29tZSBjb2x1bW5zCgpgYGB7ciwgZWNobz1UUlVFLCBldmFsPVRSVUV9CiMgUnVuIHRoZSBlbnRpcmUgZnVuY3Rpb24gd2l0aCBpbmdyZWRpZW50X3dhbnQgc2V0IHRvIGhvcHMsIGdyb3VwaW5nIGJ5IG5hbWUKaW5ncmVkaWVudHNfcGVyX2JlZXJfaG9wcyA8LSBwaWNrX2luZ3JlZGllbnRfZ2V0X2JlZXIoaW5ncmVkaWVudF93YW50ID0gImhvcHMiLCAKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYmVlcl9uZWNlc3NpdGllcywgCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGdyb3VwZXIgPSBjKCJpZCIpKQoKIyBTYW1lIGZvciBtYWx0CmluZ3JlZGllbnRzX3Blcl9iZWVyX21hbHQgPC0gcGlja19pbmdyZWRpZW50X2dldF9iZWVyKGluZ3JlZGllbnRfd2FudCA9ICJtYWx0IiwgCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGJlZXJfbmVjZXNzaXRpZXMsIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBncm91cGVyID0gYygiaWQiKSkKCiMgSm9pbiB0aG9zZSBvbiBvdXIgb3JpZ2luYWwgZGF0YWZyYW1lIGJ5IG5hbWUKYmVlcl9pbmdyZWRpZW50c19qb2luX2ZpcnN0X2luZ3JlZGllbnQgPC0gbGVmdF9qb2luKGJlZXJfbmVjZXNzaXRpZXMsIGluZ3JlZGllbnRzX3Blcl9iZWVyX2hvcHMsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBieSA9ICJpZCIpCmJlZXJfaW5ncmVkaWVudHNfam9pbiA8LSBsZWZ0X2pvaW4oYmVlcl9pbmdyZWRpZW50c19qb2luX2ZpcnN0X2luZ3JlZGllbnQsIGluZ3JlZGllbnRzX3Blcl9iZWVyX21hbHQsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYnkgPSAiaWQiKQoKCiMgVGFrZSBvdXQgc29tZSB1bm5lY2Vzc2FyeSBjb2x1bW5zCnVubmVjZXNzYXJ5X2NvbHMgPC0gYygic3R5bGVJZCIsICJhYnZfc2NhbGVkIiwgImlidV9zY2FsZWQiLCAic3JtX3NjYWxlZCIsIAogICAgICAgICAgICAgICAgICAgICAgImhvcHNfaWQiLCAibWFsdF9pZCIsICJnbGFzc3dhcmVJZCIsICJzdHlsZS5jYXRlZ29yeUlkIikKYmVlcl9pbmdyZWRpZW50c19qb2luIDwtIGJlZXJfaW5ncmVkaWVudHNfam9pblssICghIG5hbWVzKGJlZXJfaW5ncmVkaWVudHNfam9pbikgJWluJSB1bm5lY2Vzc2FyeV9jb2xzKV0KCgojIElmIHdlIGFsc28gd2FudCB0byB0YWtlIG91dCBhbnkgb2YgdGhlIG1hbHRfbmFtZV8xLCBtYWx0X25hbWVfMiwgZXRjLiBjb2x1bW5zIHdlIGNhbiBkbyB0aGlzIHdpdGggYSBncmVwCm1vcmVfdW5uZWNlc3NhcnkgPC0gYygiaG9wc19uYW1lX3xtYWx0X25hbWVfIikKYmVlcl9pbmdyZWRpZW50c19qb2luIDwtIAogIGJlZXJfaW5ncmVkaWVudHNfam9pblssICghIGdyZXBsKG1vcmVfdW5uZWNlc3NhcnksIG5hbWVzKGJlZXJfaW5ncmVkaWVudHNfam9pbikpID09IFRSVUUpXQoKIyBSZW9yZGVyIGNvbHVtbnMgYSBiaXQKYmVlcl9pbmdyZWRpZW50c19qb2luX2FsbCA8LSBiZWVyX2luZ3JlZGllbnRzX2pvaW4gJT4lIAogIHNlbGVjdCgKICAgIGlkLCBuYW1lLCB0b3RhbF9ob3BzLCB0b3RhbF9tYWx0LCBldmVyeXRoaW5nKCksIC1kZXNjcmlwdGlvbgogICkKCiMgS2VlcCBvbmx5IGJlZXJzIHRoYXQgZmFsbCBpbnRvIGEgc3R5bGVfY29sbGFwc2VkIGJ1Y2tldAojIE5vdCBmaWx0ZXJpbmcgYnkgbGV2ZWxzIGluIGJlZXJfbmVjZXNzaXRpZXMkc3R5bGVfY29sbGFwc2VkIGJlY2F1c2UgdGhvc2UgbGV2ZWxzIGNvbnRhaW4gbW9yZSB0aGFuIHdoYXQncyBpbiBqdXN0IHRoZSBrZXl3b3JkcyBvZiBjb2xsYXBzZV9zdHlsZXMoKQpiZWVyX2luZ3JlZGllbnRzX2pvaW4gPC0gYmVlcl9pbmdyZWRpZW50c19qb2luX2FsbCAlPiUgCiAgZmlsdGVyKAogICAgc3R5bGVfY29sbGFwc2VkICVpbiUgbGV2ZWxzKHN0eWxlX2NlbnRlcnMkc3R5bGVfY29sbGFwc2VkKQogICkgJT4lIAogIGRyb3BsZXZlbHMoKQoKIyBBbmQgZ2V0IGEgZGYgdGhhdCBpbmNsdWRlcyB0b3RhbF9ob3BzIGFuZCB0b3RhbF9tYWx0IGJ1dCBub3QgYWxsIHRoZSBvdGhlciBpbmdyZWRpZW50IGNvbHVtbnMKYmVlcl90b3RhbHNfYWxsIDwtIGJlZXJfaW5ncmVkaWVudHNfam9pbl9hbGwgJT4lIAogIHNlbGVjdCgKICAgIGlkLCBuYW1lLCB0b3RhbF9ob3BzLCB0b3RhbF9tYWx0LCBzdHlsZSwgc3R5bGVfY29sbGFwc2VkLAogICAgYWJ2LCBpYnUsIHNybSwgZ2xhc3MsIGhvcHNfbmFtZSwgbWFsdF9uYW1lCiAgKQoKIyBBbmQganVzdCBzdHlsZV9jb2xsYXBzZWQKYmVlcl90b3RhbHMgPC0gYmVlcl9pbmdyZWRpZW50c19qb2luICU+JSAKICBmaWx0ZXIoCiAgICBzdHlsZV9jb2xsYXBzZWQgJWluJSBsZXZlbHMoc3R5bGVfY2VudGVycyRzdHlsZV9jb2xsYXBzZWQpCiAgKSAlPiUgCiAgZHJvcGxldmVscygpCgoKYGBgCgoKTm93IHdlJ3JlIGxlZnQgd2l0aCBzb21ldGhpbmcgb2YgYSBzcGFyc2UgbWF0cml4IG9mIGFsbCB0aGUgaW5ncmVkaWVudHMgY29tcGFyZWQgdG8gYWxsIHRoZSBiZWVycwpgYGB7cn0Ka2FibGUoYmVlcl9pbmdyZWRpZW50c19qb2luWzE6MjAsIF0pCmBgYAoKCgoqKioKCk5vdyB0aGF0IHRoZSBtdW5naW5nIGlzIGRvbmUsIG9udG8gdGhlIG1haW4gcXVlc3Rpb246IGRvIG5hdHVyYWwgY2x1c3RlcnMgaW4gYmVlciBhbGlnbiB3aXRoIHN0eWxlIGJvdW5kYXJpZXM/CgoKKioqCgojIyMgVW5zdXBlcnZpc2VkIENsdXN0ZXJpbmcgCldlIEstbWVhbnMgY2x1c3RlciBiZWVycyBiYXNlZCBvbiBjZXJ0YWluIG51bWVyaWMgcHJlZGljdG9yIHZhcmlhYmxlcy4gCgoKKipQcmVwKioKCiogV3JpdGUgYSBmdW5jaXRvbiB0aGF0IHRha2VzIGEgZGF0YWZyYW1lLCBhIHNldCBvZiBwcmVkaWN0b3JzLCBhIHJlc3BvbnNlIHZhcmlhYmxlLCBhbmQgdGhlIG51bWJlciBvZiBjbHVzdGVyIGNlbnRlcnMgeW91IHdhbnQKICAgICogTkI6IFRoZXJlIGFyZSBub3Qgbm90IHZlcnkgbWFueSBiZWVycyBoYXZlIFNSTSBzbyB3ZSBtYXkgbm90IHdhbnQgdG8gb21pdCBiYXNlZCBvbiBpdAoKKiBUYWtlIG91dCBtaXNzaW5nIHZhbHVlcywgYW5kIHNjYWxlIHRoZSBkYXRhCiogVGFrZSBvdXQgb3V0bGllcnMsIGRlZmluZWQgYXMgYmVlcnMgaGF2ZSB0byBoYXZlIGFuIEFCViBiZXR3ZWVuIDMgYW5kIDIwIGFuZCBhbiBJQlUgbGVzcyB0aGFuIDIwMAoqIFRoZW4gY2x1c3RlciBvbiBqdXN0IHRoZSBwcmVkaWN0b3JzIGFuZCBjb21wYXJlIHRvIHRoZSByZXNwb25zZSB2YXJpYWJsZQogIAoKYGBge3IsIGVjaG89VFJVRX0KCmxpYnJhcnkoTmJDbHVzdCkKCmNsdXN0ZXJfaXQgPC0gZnVuY3Rpb24oZGYsIHByZWRzLCB0b19zY2FsZSwgcmVzcCwgbl9jZW50ZXJzKSB7CiAgZGZfZm9yX2NsdXN0ZXJpbmcgPC0gZGYgJT4lCiAgICBzZWxlY3RfKC5kb3RzID0gYyhyZXNwb25zZV92YXJzLCBjbHVzdGVyX29uKSkgJT4lCiAgICBuYS5vbWl0KCkgJT4lCiAgICBmaWx0ZXIoCiAgICAgIGFidiA8IDIwICYgYWJ2ID4gMwogICAgKSAlPiUKICAgIGZpbHRlcigKICAgICAgaWJ1IDwgMjAwCiAgICApCgogIGRmX2FsbF9wcmVkcyA8LSBkZl9mb3JfY2x1c3RlcmluZyAlPiUKICAgIHNlbGVjdF8oLmRvdHMgPSBwcmVkcykKCiAgZGZfcHJlZHNfc2NhbGUgPC0gZGZfYWxsX3ByZWRzICU+JQogICAgc2VsZWN0XyguZG90cyA9IHRvX3NjYWxlKSAlPiUKICAgIHJlbmFtZSgKICAgICAgYWJ2X3NjYWxlZCA9IGFidiwKICAgICAgaWJ1X3NjYWxlZCA9IGlidSwKICAgICAgc3JtX3NjYWxlZCA9IHNybQogICAgKSAlPiUKICAgIHNjYWxlKCkgJT4lCiAgICBhc190aWJibGUoKQoKICBkZl9wcmVkcyA8LSBiaW5kX2NvbHMoZGZfcHJlZHNfc2NhbGUsIGRmX2FsbF9wcmVkc1ssICghbmFtZXMoZGZfYWxsX3ByZWRzKSAlaW4lIHRvX3NjYWxlKV0pCgogIGRmX291dGNvbWUgPC0gZGZfZm9yX2NsdXN0ZXJpbmcgJT4lCiAgICBzZWxlY3RfKC5kb3RzID0gcmVzcCkgJT4lCiAgICBuYS5vbWl0KCkKCiAgc2V0LnNlZWQoOSkKICBjbHVzdGVyZWRfZGZfb3V0IDwtIGttZWFucyh4ID0gZGZfcHJlZHMsIGNlbnRlcnMgPSBuX2NlbnRlcnMsIHRyYWNlID0gRkFMU0UpCgogIGNsdXN0ZXJlZF9kZiA8LSBhc190aWJibGUoZGF0YS5mcmFtZSgKICAgIGNsdXN0ZXJfYXNzaWdubWVudCA9IGZhY3RvcihjbHVzdGVyZWRfZGZfb3V0JGNsdXN0ZXIpLAogICAgZGZfb3V0Y29tZSwgZGZfcHJlZHMsCiAgICBkZl9mb3JfY2x1c3RlcmluZyAlPiUgc2VsZWN0KGFidiwgaWJ1LCBzcm0pKSkKCiAgcmV0dXJuKGNsdXN0ZXJlZF9kZikKfQoKYGBgCgoKCiAKKipDbHVzdGVyKioKCkZpcnN0IHdlJ2xsIHJ1biB0aGUgZnVjdGlvbiB3aXRoIDEwIGNlbnRlcnMsIGFuZCBjbHVzdGVyIG9uIHRoZSBwcmVkaWN0b3JzIEFCViwgSUJVLCBTUk0sIHRvdGFsX2hvcHMsIGFuZCB0b3RhbF9tYWx0LgoKCmBgYHtyLCBlY2hvPVRSVUV9CgpjbHVzdGVyX29uIDwtIGMoImFidiIsICJpYnUiLCAic3JtIiwgInRvdGFsX2hvcHMiLCAidG90YWxfbWFsdCIpCnRvX3NjYWxlIDwtIGMoImFidiIsICJpYnUiLCAic3JtIiwgInRvdGFsX2hvcHMiLCAidG90YWxfbWFsdCIpCnJlc3BvbnNlX3ZhcnMgPC0gYygibmFtZSIsICJzdHlsZSIsICJzdHlsZV9jb2xsYXBzZWQiKQoKY2x1c3RlcmVkX2JlZXIgPC0gY2x1c3Rlcl9pdChkZiA9IGJlZXJfdG90YWxzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIHByZWRzID0gY2x1c3Rlcl9vbiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICB0b19zY2FsZSA9IHRvX3NjYWxlLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIHJlc3AgPSByZXNwb25zZV92YXJzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgIG5fY2VudGVycyA9IDEwKQpgYGAKCgpIZWFkIG9mIHRoZSByZXN1bHRpbmcgY2x1c3RlcmVkIGRhdGEuIENsdXN0ZXIgYXNzaWdubWVudCBjb2x1bW4gb24gdGhlIGZhciBsZWZ0LgpgYGB7ciwgZWNobz1UUlVFfQprYWJsZShjbHVzdGVyZWRfYmVlclsxOjIwLCBdKQoKIyBIb3cgbWFueSByb3dzIGRvIHdlIGhhdmU/Cm5yb3coY2x1c3RlcmVkX2JlZXIpCmBgYAoKSm9pbiB0aGUgY2x1c3RlcmVkIGJlZXIgb24gYGJlZXJfaW5ncmVkaWVudHNfam9pbmAKYGBge3J9CmJlZXJfaW5ncmVkaWVudHNfam9pbl9jbHVzdGVyZWQgPC0gbGVmdF9qb2luKGJlZXJfaW5ncmVkaWVudHNfam9pbiwgY2x1c3RlcmVkX2JlZXIsIAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBieSA9ICJuYW1lIikKYGBgCgoKQSB0YWJsZSBvZiBjbHVzdGVyIGNvdW50cyBicm9rZW4gZG93biBieSBzdHlsZQpgYGB7cn0KY2x1c3Rlcl90YWJsZV9jb3VudHMgPC0gdGFibGUoc3R5bGUgPSBjbHVzdGVyZWRfYmVlciRzdHlsZV9jb2xsYXBzZWQsIGNsdXN0ZXIgPSBjbHVzdGVyZWRfYmVlciRjbHVzdGVyX2Fzc2lnbm1lbnQpCgprYWJsZShjbHVzdGVyX3RhYmxlX2NvdW50cykKYGBgCgoKUGxvdCB0aGUgY2x1c3RlcnMuIFRoZXJlIGFyZSAzIGF4ZXM6IEFCViwgSUJVLCBhbmQgU1JNLCBzbyB3ZSBjaG9vc2UgdHdvIGF0IGEgdGltZS4gCgpgYGB7ciwgZWNobz1UUlVFfQpjbHVzdGVyZWRfYmVlcl9wbG90X2Fidl9pYnUgPC0gZ2dwbG90KGRhdGEgPSBjbHVzdGVyZWRfYmVlciwgYWVzKHggPSBhYnYsIHkgPSBpYnUsIGNvbG91ciA9IGNsdXN0ZXJfYXNzaWdubWVudCkpICsgCiAgZ2VvbV9qaXR0ZXIoKSArIHRoZW1lX21pbmltYWwoKSAgKwogIGdndGl0bGUoImstTWVhbnMgQ2x1c3RlcmluZyBvZiBCZWVyIGJ5IEFCViwgSUJVLCBTUk0iKSArCiAgbGFicyh4ID0gIkFCViIsIHkgPSAiSUJVIikgKwogIGxhYnMoY29sb3VyID0gIkNsdXN0ZXIgQXNzaWdubWVudCIpCmNsdXN0ZXJlZF9iZWVyX3Bsb3RfYWJ2X2lidQoKY2x1c3RlcmVkX2JlZXJfcGxvdF9hYnZfc3JtIDwtIGdncGxvdChkYXRhID0gY2x1c3RlcmVkX2JlZXIsIGFlcyh4ID0gYWJ2LCB5ID0gc3JtLCBjb2xvdXIgPSBjbHVzdGVyX2Fzc2lnbm1lbnQpKSArIAogIGdlb21faml0dGVyKCkgKyB0aGVtZV9taW5pbWFsKCkgICsKICBnZ3RpdGxlKCJrLU1lYW5zIENsdXN0ZXJpbmcgb2YgQmVlciBieSBBQlYsIElCVSwgU1JNIikgKwogIGxhYnMoeCA9ICJBQlYiLCB5ID0gIlNSTSIpICsKICBsYWJzKGNvbG91ciA9ICJDbHVzdGVyIEFzc2lnbm1lbnQiKQpjbHVzdGVyZWRfYmVlcl9wbG90X2Fidl9zcm0KYGBgCgoKCk5vdyB3ZSBjYW4gYWRkIGluIHRoZSBzdHlsZSBjZW50ZXJzIChtZWFucykgZm9yIGVhY2ggYHN0eWxlX2NvbGxhcHNlZGAgYW5kIGxhYmVsIGl0LgoKYGBge3IsIGVjaG89VFJVRX0KbGlicmFyeShnZ3JlcGVsKQphYnZfaWJ1X2NsdXN0ZXJzX3ZzX3N0eWxlX2NlbnRlcnMgPC0gZ2dwbG90KCkgKyAgIAogIGdlb21fcG9pbnQoZGF0YSA9IGNsdXN0ZXJlZF9iZWVyLCAKICAgICAgICAgICAgIGFlcyh4ID0gYWJ2LCB5ID0gaWJ1LCBjb2xvdXIgPSBjbHVzdGVyX2Fzc2lnbm1lbnQpLCBhbHBoYSA9IDAuNSkgKwogIGdlb21fcG9pbnQoZGF0YSA9IHN0eWxlX2NlbnRlcnMsCiAgICAgICAgICAgICBhZXMobWVhbl9hYnYsIG1lYW5faWJ1KSwgY29sb3VyID0gImJsYWNrIikgKwogIGdlb21fdGV4dF9yZXBlbChkYXRhID0gc3R5bGVfY2VudGVycywgYWVzKG1lYW5fYWJ2LCBtZWFuX2lidSwgbGFiZWwgPSBzdHlsZV9jb2xsYXBzZWQpLCAKICAgICAgICAgICAgICAgICAgYm94LnBhZGRpbmcgPSB1bml0KDAuNDUsICJsaW5lcyIpLAogICAgICAgICAgICAgICAgICBmYW1pbHkgPSAiQ2FsaWJyaSIsCiAgICAgICAgICAgICAgICAgIGxhYmVsLnNpemUgPSAwLjMpICsKICBnZ3RpdGxlKCJQb3B1bGFyIFN0eWxlcyB2cy4gay1NZWFucyBDbHVzdGVyaW5nIG9mIEJlZXIgYnkgQUJWLCBJQlUsIFNSTSIpICsKICBsYWJzKHggPSAiQUJWIiwgeSA9ICJJQlUiKSArCiAgbGFicyhjb2xvdXIgPSAiQ2x1c3RlciBBc3NpZ25tZW50IikgKwogIHRoZW1lX2J3KCkKYWJ2X2lidV9jbHVzdGVyc192c19zdHlsZV9jZW50ZXJzCmBgYAoKClRoZSBjbHVzdGVyaW5nIGFib3ZlIHVzZWQgYSBzbWFsbGVyIG51bWJlciBvZiBjbHVzdGVycyAoMTApIHRoYW4gdGhlcmUgYXJlIGBzdHlsZXNfY29sbGFwc2VkYC4gVGhhdCBtYWtlcyBpdCBkaWZmaWN1bHQgdG8gZGV0ZXJtaW5lIHdoZXRoZXIgYSBnaXZlbiBzdHlsZSBmaXRzIHNudWdseSBpbnRvIGEgY2x1c3RlciBvciBub3QuCgoKCioqQ2x1c3RlciBvbiBqdXN0IGNlcnRhaW4gc2VsZWN0ZWQgc3R5bGVzKioKCldlJ2xsIHRha2UgZml2ZSB2ZXJ5IGRpc3RpbmN0IGNvbGxhcHNlZCBzdHlsZXMgYW5kIHJlLXJ1biB0aGUgY2x1c3RlcmluZyBvbiBiZWVycyB0aGF0IGZhbGwgaW50byB0aGVzZSBjYXRlZ29yaWVzLiAKVGhlc2Ugc3R5bGVzIHdlcmUgaW50ZW50aW9uYWxseSBjaG9zZW4gYmVjYXVzZSB0aGV5IGFyZSBxdWl0ZSBkaXN0aW5jdDogQmxvbmRlLCBJUEEsIFN0b3V0LCBUcmlwZWwsIFdoZWF0LiBBcmd1YWJseSwgb2YgdGhlc2UgZml2ZSBzdHlsZXMgQmxvbmRlcyBhbmQgV2hlYXRzIGFyZSB0aGUgY2xvc2VzdAoKCgpgYGB7ciwgZWNobz1UUlVFfQpzdHlsZXNfdG9fa2VlcCA8LSBjKCJCbG9uZGUiLCAiSW5kaWEgUGFsZSBBbGUiLCAiU3RvdXQiLCAiVHJpcGVsIiwgIldoZWF0IikKYnRfY2VydGFpbl9zdHlsZXMgPC0gYmVlcl90b3RhbHMgJT4lCiAgZmlsdGVyKAogICAgc3R5bGVfY29sbGFwc2VkICVpbiUgc3R5bGVzX3RvX2tlZXAKICApICU+JSAKICBkcm9wbGV2ZWxzKCkKCgpjbHVzdGVyX29uIDwtIGMoImFidiIsICJpYnUiLCAic3JtIiwgInRvdGFsX2hvcHMiLCAidG90YWxfbWFsdCIpCnRvX3NjYWxlIDwtIGMoImFidiIsICJpYnUiLCAic3JtIiwgInRvdGFsX2hvcHMiLCAidG90YWxfbWFsdCIpCnJlc3BvbnNlX3ZhcnMgPC0gYygibmFtZSIsICJzdHlsZSIsICJzdHlsZV9jb2xsYXBzZWQiKQoKY2VydGFpbl9zdHlsZXNfY2x1c3RlcmVkIDwtIGNsdXN0ZXJfaXQoZGYgPSBidF9jZXJ0YWluX3N0eWxlcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcHJlZHMgPSBjbHVzdGVyX29uLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB0b19zY2FsZSA9IHRvX3NjYWxlLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICByZXNwID0gcmVzcG9uc2VfdmFycywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbl9jZW50ZXJzID0gNSkKCnN0eWxlX2NlbnRlcnNfY2VydGFpbl9zdHlsZXMgPC0gc3R5bGVfY2VudGVycyAlPiUgCiAgZmlsdGVyKHN0eWxlX2NvbGxhcHNlZCAlaW4lIHN0eWxlc190b19rZWVwKQpgYGAKCgoKCgpUYWJsZSBvZiBzdHlsZSB2cy4gY2x1c3Rlci4KYGBge3IsIGVjaG89VFJVRX0Ka2FibGUodGFibGUoc3R5bGUgPSBjZXJ0YWluX3N0eWxlc19jbHVzdGVyZWQkc3R5bGVfY29sbGFwc2VkLCBjbHVzdGVyID0gY2VydGFpbl9zdHlsZXNfY2x1c3RlcmVkJGNsdXN0ZXJfYXNzaWdubWVudCkpCmBgYAoKCgpOb3cgdGhhdCB3ZSBoYXZlIGEgbWFuYWdlYWJsZSBudW1iZXIgb2Ygc3R5bGVzLCB3ZSBjYW4gc2VlIGhvdyB3ZWxsIGZpdCBlYWNoIGNsdXN0ZXIgaXMgdG8gZWFjaCBzdHlsZS4gSWYgdGhlIGZlYXR1cmVzIHdlIGNsdXN0ZXJlZCBvbiBwZXJmZWN0bHkgcHJlZGljdGVkIHN0eWxlLCB0aGVyZSB3b3VsZCBlYWNoIGNvbG9yIChjbHVzdGVyKSB3b3VsZCBiZSB1bmlxdWUgdG8gZWFjaCBmYWNldCBvZiB0aGUgcGxvdC4gKEUuZy4sIGxlZnQgZW50aXJlbHkgYmx1ZSwgc2Vjb25kIGZyb20gbGVmdCBlbnRpcmVseSBncmVlbiwgZXRjLikKCgoKYGBge3IsIGVjaG89VFJVRX0KYnlfc3R5bGVfcGxvdCA8LSBnZ3Bsb3QoKSArICAgCiAgZ2VvbV9wb2ludChkYXRhID0gY2VydGFpbl9zdHlsZXNfY2x1c3RlcmVkLCAKICAgICAgICAgICAgIGFlcyh4ID0gYWJ2LCB5ID0gaWJ1LAogICAgICAgICAgICAgICAgIGNvbG91ciA9IGNsdXN0ZXJfYXNzaWdubWVudCksIGFscGhhID0gMC41KSArCiAgZmFjZXRfZ3JpZCguIH4gc3R5bGVfY29sbGFwc2VkKSArCiAgZ2VvbV9wb2ludChkYXRhID0gc3R5bGVfY2VudGVyc19jZXJ0YWluX3N0eWxlcywKICAgICAgICAgICBhZXMobWVhbl9hYnYsIG1lYW5faWJ1KSwgY29sb3VyID0gImJsYWNrIiwgc2hhcGUgPSA1KSArCiAgZ2d0aXRsZSgiU2VsZWN0ZWQgU3R5bGVzIENsdXN0ZXIgQXNzaWdubWVudCIpICsKICBsYWJzKHggPSAiQUJWIiwgeSA9ICJJQlUiKSArCiAgbGFicyhjb2xvdXIgPSAiQ2x1c3RlciIpICsKICB0aGVtZV9idygpCmJ5X3N0eWxlX3Bsb3QKYGBgCgoKCgo8IS0tICMjIyBCYWNrIHRvIGNsdXN0ZXJpbmc6IGNsdXN0ZXIgb24gb25seSA1IHN0eWxlcyAtLT4KCjwhLS0gKiBXZSdsbCBwYXJlIGRvd24gdGhlIGJlZXIgZGF0YSB0byBqdXN0IGJlZXJzIGluIDUgc2VsZWN0ZWQgc3R5bGVzOyAKPCEtLSAqIFdlJ2xsIGNsdXN0ZXIgdGhlc2UgaW50byA1IGNsdXN0ZXJzIC0tPgo8IS0tIDwhLS0gKiBUaGlzIHRpbWUgd2UnbGwgYWRkIGluIGB0b3RhbF9ob3BzYCBhbmQgYHRvdGFsX21hbHRgIGFzIHByZWRpY3RvcnMgIC0tPiAtLT4KCgoKCjwhLS0gZ2dwbG90KCkgKyAtLT4KPCEtLSAgIGdlb21fcG9pbnQoZGF0YSA9IGNlcnRhaW5fc3R5bGVzX2NsdXN0ZXJlZCwgLS0+CjwhLS0gICAgICAgICAgICAgIGFlcyh4ID0gYWJ2LCB5ID0gaWJ1LCAtLT4KPCEtLSAgICAgICAgICAgICAgICAgIHNoYXBlID0gY2x1c3Rlcl9hc3NpZ25tZW50LCAtLT4KPCEtLSAgICAgICAgICAgICAgICAgIGNvbG91ciA9IHN0eWxlX2NvbGxhcHNlZCksIGFscGhhID0gMC41KSArIC0tPgo8IS0tICAgZ2VvbV9wb2ludChkYXRhID0gc3R5bGVfY2VudGVyc19jZXJ0YWluX3N0eWxlcywgLS0+CjwhLS0gICAgICAgICAgICAgIGFlcyhtZWFuX2FidiwgbWVhbl9pYnUpLCBjb2xvdXIgPSAiYmxhY2siKSArIC0tPgo8IS0tICAgZ2VvbV90ZXh0X3JlcGVsKGRhdGEgPSBzdHlsZV9jZW50ZXJzX2NlcnRhaW5fc3R5bGVzLCAtLT4KPCEtLSAgICAgICAgICAgICAgICAgICBhZXMobWVhbl9hYnYsIG1lYW5faWJ1LCBsYWJlbCA9IHN0eWxlX2NvbGxhcHNlZCksIC0tPgo8IS0tICAgICAgICAgICAgICAgICAgIGJveC5wYWRkaW5nID0gdW5pdCgwLjQ1LCAibGluZXMiKSwgLS0+CjwhLS0gICAgICAgICAgICAgICAgICAgZmFtaWx5ID0gIkNhbGlicmkiLCAtLT4KPCEtLSAgICAgICAgICAgICAgICAgICBsYWJlbC5zaXplID0gMC4zKSArIC0tPgo8IS0tICAgZ2d0aXRsZSgiU2VsZWN0ZWQgU3R5bGVzIChjb2xvcnMpIG1hdGNoZWQgd2l0aCBDbHVzdGVyIEFzc2lnbm1lbnRzIChzaGFwZXMpIikgKyAtLT4KPCEtLSAgIGxhYnMoeCA9ICJBQlYiLCB5ID0gIklCVSIpICsgLS0+CjwhLS0gICBsYWJzKGNvbG91ciA9ICJTdHlsZSIsIHNoYXBlID0gIkNsdXN0ZXIgQXNzaWdubWVudCIpICsgLS0+CjwhLS0gICB0aGVtZV9idygpIC0tPgoKPCEtLSBgYGAgLS0+CgoKCiMjIFJhbmRvbSBhc2lkZXMgaW50byBob3BzCgoqKkRvIG1vcmUgaG9wcyBhbHdheXMgbWVhbiBtb3JlIGJpdHRlcm5lc3M/KioKCiogSXQgd291bGQgYXBwZWFyIHNvLCBmcm9tIHRoaXMgZ3JhcGggKGNvbnNpZGVyaW5nIG9ubHkgYmVlciBpbiB0aGUgbW9zdCBwb3B1bGFyIHN0eWxlcykgYW5kIHRoaXMgcmVncmVzc2lvbiAoYmV0YSA9IDIuMzk0NDE4KQpgYGB7ciwgZWNobz1UUlVFfQpnZ3Bsb3QoZGF0YSA9IGJlZXJfaW5ncmVkaWVudHNfam9pbiwgYWVzKHRvdGFsX2hvcHMsIGlidSkpICsKICBnZW9tX3BvaW50KGFlcyh0b3RhbF9ob3BzLCBpYnUsIGNvbG91ciA9IHN0eWxlX2NvbGxhcHNlZCkpICsKICBnZW9tX3Ntb290aChtZXRob2QgPSBsbSwgc2UgPSBGQUxTRSwgY29sb3VyID0gImJsYWNrIikgKyAKICBnZ3RpdGxlKCJIb3BzIFBlciBCZWVyIHZzLiBCaXR0ZXJuZXNzIikgKwogIGxhYnMoeCA9ICJOdW1iZXIgb2YgSG9wcyIsIHkgPSAiSUJVIiwgY29sb3VyID0gIlN0eWxlIENvbGxhcHNlZCIpICsKICB0aGVtZV9taW5pbWFsKCkKCmBgYAoKClJlZ3Jlc3NpbmcgdG90YWwgbnVtYmVyIG9mIGhvcHMgb24gYml0dGVybmVzcyAoSUJVKToKYGBge3IsIGVjaG8gPSBUUlVFfQpob3BzX2lidV9sbSA8LSBsbShpYnUgfiB0b3RhbF9ob3BzLCBkYXRhID0gYmVlcl9pbmdyZWRpZW50c19qb2luKQpzdW1tYXJ5KGhvcHNfaWJ1X2xtKQpgYGAKCgoqIEhvd2V2ZXIsIHBhc3QgYSBjZXJ0YWluIHBvaW50ICgzIGhvcHMgb3IgbW9yZSksIHRoZXJlJ3Mgbm8gZWZmZWN0IG9mIG51bWJlciBvZiBob3BzIG9uIElCVQpgYGB7ciwgZWNobz1UUlVFfQpnZ3Bsb3QoZGF0YSA9IGJlZXJfaW5ncmVkaWVudHNfam9pblt3aGljaChiZWVyX2luZ3JlZGllbnRzX2pvaW4kdG90YWxfaG9wcyA+IDIKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgJiBiZWVyX2luZ3JlZGllbnRzX2pvaW4kdG90YWxfaG9wcyA8IDgpLCBdLCBhZXModG90YWxfaG9wcywgaWJ1KSkgKwogIGdlb21fcG9pbnQoYWVzKHRvdGFsX2hvcHMsIGlidSwgY29sb3VyID0gc3R5bGVfY29sbGFwc2VkKSkgKwogIGdlb21fc21vb3RoKG1ldGhvZCA9IGxtLCBzZSA9IEZBTFNFLCBjb2xvdXIgPSAiYmxhY2siKSArCiAgZ2d0aXRsZSgiMysgSG9wcyBQZXIgQmVlciB2cy4gQml0dGVybmVzcyIpICsKICBsYWJzKHggPSAiTnVtYmVyIG9mIEhvcHMiLCB5ID0gIklCVSIsIGNvbG91ciA9ICJTdHlsZSBDb2xsYXBzZWQiKSArCiAgdGhlbWVfbWluaW1hbCgpCmBgYAoKCioqTW9zdCBwb3B1bGFyIGhvcHMqKgoKYGBge3IsIGVjaG89VFJVRX0KIyBHYXRoZXIgdXAgYWxsIHRoZSBob3BzIGNvbHVtbnMgaW50byBvbmUgY2FsbGVkIGBob3BfbmFtZWAKYmVlcl9uZWNlc3NpdGllc19ob3BzX2dhdGhlcmVkIDwtIGJlZXJfbmVjZXNzaXRpZXMgJT4lCiAgZ2F0aGVyKAogICAgaG9wX2tleSwgaG9wX25hbWUsIGhvcHNfbmFtZV8xOmhvcHNfbmFtZV8xMwogICkgJT4lIGFzX3RpYmJsZSgpCgojIEZpbHRlciB0byBqdXN0IHRob3NlIGJlZXJzIHRoYXQgaGF2ZSBhdCBsZWFzdCBvbmUgaG9wCmJlZXJfbmVjZXNzaXRpZXNfd19ob3BzIDwtIGJlZXJfbmVjZXNzaXRpZXNfaG9wc19nYXRoZXJlZCAlPiUgCiAgZmlsdGVyKCFpcy5uYShob3BfbmFtZSkpICU+JSAKICBmaWx0ZXIoIWhvcF9uYW1lID09ICIiKQoKYmVlcl9uZWNlc3NpdGllc193X2hvcHMkaG9wX25hbWUgPC0gZmFjdG9yKGJlZXJfbmVjZXNzaXRpZXNfd19ob3BzJGhvcF9uYW1lKQoKIyBGb3IgYWxsIGhvcHMsIGZpbmQgdGhlIG51bWJlciBvZiBiZWVycyB0aGV5J3JlIGluIGFzIHdlbGwgYXMgdGhvc2UgYmVlcnMnIG1lYW4gSUJVIGFuZCBBQlYKaG9wc19iZWVyX3N0YXRzIDwtIGJlZXJfbmVjZXNzaXRpZXNfd19ob3BzICU+JSAKICB1bmdyb3VwKCkgJT4lIAogIGdyb3VwX2J5KGhvcF9uYW1lKSAlPiUgCiAgc3VtbWFyaXNlKAogICAgbWVhbl9pYnUgPSBtZWFuKGlidSwgbmEucm0gPSBUUlVFKSwgCiAgICBtZWFuX2FidiA9IG1lYW4oYWJ2LCBuYS5ybSA9IFRSVUUpLAogICAgbiA9IG4oKQogICkKCiMgUGFyZSB0byBob3BzIHRoYXQgYXJlIHVzZWQgaW4gYXQgbGVhc3QgNTAgYmVlcnMKcG9wX2hvcHNfYmVlcl9zdGF0cyA8LSBob3BzX2JlZXJfc3RhdHNbaG9wc19iZWVyX3N0YXRzJG4gPiA1MCwgXQprYWJsZShwb3BfaG9wc19iZWVyX3N0YXRzKQoKIyBLZWVwIGp1c3QgYmVlcnMgdGhhdCBjb250YWluIHRoZXNlIG1vc3QgcG9wdWxhciBob3BzCmJlZXJfbmVjZXNzaXRpZXNfd19wb3B1bGFyX2hvcHMgPC0gYmVlcl9uZWNlc3NpdGllc193X2hvcHMgJT4lIAogIGZpbHRlcihob3BfbmFtZSAlaW4lIHBvcF9ob3BzX2JlZXJfc3RhdHMkaG9wX25hbWUpICU+JSAKICBkcm9wbGV2ZWxzKCkgCmBgYAoKQXJlIHRoZXJlIGNlcnRpYW4gaG9wcyB0aGF0IGFyZSB1c2VkIG1vcmUgb2Z0ZW4gaW4gdmVyeSBoaWdoIElCVSBvciBBQlYgYmVlcnM/CkhhcmQgdG8gZGV0ZWN0IGEgcGF0dGVybgpgYGB7ciwgZWNobyA9IFRSVUV9CmdncGxvdChkYXRhID0gYmVlcl9uZWNlc3NpdGllc193X3BvcHVsYXJfaG9wcykgKyAKICBnZW9tX3BvaW50KGFlcyhhYnYsIGlidSwgY29sb3VyID0gaG9wX25hbWUpKSArCiAgZ2d0aXRsZSgiQmVlcnMgQ29udGFpbmluZyBtb3N0IFBvcHVsYXIgSG9wcyIpICsKICBsYWJzKHggPSAiQUJWIiwgeSA9ICJJQlUiLCBjb2xvdXIgPSAiSG9wIE5hbWUiKSArCiAgdGhlbWVfbWluaW1hbCgpCmBgYAoKYGBge3IsIGVjaG89VFJVRX0KZ2dwbG90KGRhdGEgPSBwb3BfaG9wc19iZWVyX3N0YXRzKSArIAogIGdlb21fcG9pbnQoYWVzKG1lYW5fYWJ2LCBtZWFuX2lidSwgY29sb3VyID0gaG9wX25hbWUsIHNpemUgPSBuKSkgKwogIGdndGl0bGUoIk1vc3QgUG9wdWxhciBIb3BzJyBFZmZlY3Qgb24gQWxjb2hvbCBhbmQgQml0dGVybmVzcyIpICsKICBsYWJzKHggPSAiTWVhbiBBQlYgcGVyIEhvcCBUeXBlIiwgeSA9ICJNZWFuIElCVSBwZXIgSG9wIFR5cGUiLCBjb2xvdXIgPSAiSG9wIE5hbWUiLCAKICAgICAgIHNpemUgPSAiTnVtYmVyIG9mIEJlZXJzIikgKwogIHRoZW1lX21pbmltYWwoKQpgYGAKCgojIE5ldXJhbCBOZXQKCiogQ2FuIEFCViwgSUJVLCBhbmQgU1JNIGJlIHVzZWQgaW4gYSBuZXVyYWwgbmV0IHRvIHByZWRpY3QgYHN0eWxlYCBvciBgc3R5bGVfY29sbGFwc2VkYD8KKiBJbiB0aGUgZnVuY3Rpb24sIHNwZWNpZnkgdGhlIGRhdGFmcmFtZSBhbmQgdGhlIG91dGNvbWUsIGVpdGhlciBgc3R5bGVgIG9yIGBzdHlsZV9jb2xsYXBzZWRgOyB0aGUgb25lIG5vdCBzcGVjaWZpZWQgYXMgYG91dGNvbWVgIHdpbGwgYmUgZHJvcHBlZAoqIFRoZSBwcmVkaWN0b3IgY29sdW1ucyB3aWxsIGJlIGV2ZXJ5dGhpbmcgbm90IHNwZWNpZmllZCBpbiB0aGUgdmVjdG9yIGBwcmVkaWN0b3JfdmFyc2AKKiBUaGUgZnVuY3Rpb24gcmV0dXJucyB0aGUgb3V0Y29tZSB2YXJpYWJsZSBzbGVlY3RlZCwgbmV1cmFsIG5ldCBvdXRwdXQsIHZhcmlhYmxlIGltcG9ydGFuY2UsIHRoZSBwcmVkaWN0aW9uIGRhdGFmcmFtZSwgcHJlZGljdGlvbnMsIGFuZCBhY2N1cmFjeQoKYGBge3IsIHdhcm5pbmc9RkFMU0UsIGVjaG89VFJVRSwgZXZhbD1UUlVFLCBtZXNzYWdlPUZBTFNFfQoKbGlicmFyeShubmV0KQpsaWJyYXJ5KGNhcmV0KQoKcnVuX25ldXJhbF9uZXQgPC0gZnVuY3Rpb24oZGYsIG91dGNvbWUsIHByZWRpY3Rvcl92YXJzKSB7CiAgb3V0IDwtIGxpc3Qob3V0Y29tZSA9IG91dGNvbWUpCiAgCiAgIyBDcmVhdGUgYSBuZXcgY29sdW1uIG91dGNvbWU7IGl0J3Mgc3R5bGVfY29sbGFwc2VkIGlmIHlvdSBzZXQgb3V0Y29tZSB0byBzdHlsZV9jb2xsYXBzZWQsIGFuZCBzdHlsZSBvdGhlcndpc2UKICBpZiAob3V0Y29tZSA9PSAic3R5bGVfY29sbGFwc2VkIikgewogICAgZGZbWyJvdXRjb21lIl1dIDwtIGRmW1sic3R5bGVfY29sbGFwc2VkIl1dCiAgfSBlbHNlIHsKICAgIGRmW1sib3V0Y29tZSJdXSA8LSBkZltbInN0eWxlIl1dCiAgfQoKICBkZiRvdXRjb21lIDwtIGZhY3RvcihkZiRvdXRjb21lKQogIAogIGNvbHNfdG9fa2VlcCA8LSBjKCJvdXRjb21lIiwgcHJlZGljdG9yX3ZhcnMpCiAgCiAgZGYgPC0gZGYgJT4lCiAgICBzZWxlY3RfKC5kb3RzID0gY29sc190b19rZWVwKSAlPiUKICAgIG11dGF0ZShyb3cgPSAxOm5yb3coZGYpKSAlPiUgCiAgICBkcm9wbGV2ZWxzKCkKCiAgIyBTZWxlY3QgODAlIG9mIHRoZSBkYXRhIGZvciB0cmFpbmluZwogIGRmX3RyYWluIDwtIHNhbXBsZV9uKGRmLCBucm93KGRmKSooMC44KSkKICAKICAjIFRoZSByZXN0IGlzIGZvciB0ZXN0aW5nCiAgZGZfdGVzdCA8LSBkZiAlPiUKICAgIGZpbHRlcighIChyb3cgJWluJSBkZl90cmFpbiRyb3cpKSAlPiUKICAgIHNlbGVjdCgtcm93KQogIAogIGRmX3RyYWluIDwtIGRmX3RyYWluICU+JQogICAgc2VsZWN0KC1yb3cpCiAgCiAgIyBCdWlsZCBtdWx0aW5vbWFpbCBuZXVyYWwgbmV0CiAgbm4gPC0gbXVsdGlub20ob3V0Y29tZSB+IC4sCiAgICAgICAgICAgICAgICAgZGF0YSA9IGRmX3RyYWluLCBtYXhpdD01MDAsIHRyYWNlPUZBTFNFKQoKICAjIFdoaWNoIHZhcmlhYmxlcyBhcmUgdGhlIG1vc3QgaW1wb3J0YW50IGluIHRoZSBuZXVyYWwgbmV0PwogIG1vc3RfaW1wb3J0YW50X3ZhcnMgPC0gdmFySW1wKG5uKQoKICAjIEhvdyBhY2N1cmF0ZSBpcyB0aGUgbW9kZWw/IENvbXBhcmUgcHJlZGljdGlvbnMgdG8gb3V0Y29tZXMgZnJvbSB0ZXN0IGRhdGEKICBubl9wcmVkcyA8LSBwcmVkaWN0KG5uLCB0eXBlPSJjbGFzcyIsIG5ld2RhdGEgPSBkZl90ZXN0KQogIG5uX2FjY3VyYWN5IDwtIHBvc3RSZXNhbXBsZShkZl90ZXN0JG91dGNvbWUsIG5uX3ByZWRzKQoKICBvdXQgPC0gbGlzdChvdXQsIG5uID0gbm4sIG1vc3RfaW1wb3J0YW50X3ZhcnMgPSBtb3N0X2ltcG9ydGFudF92YXJzLAogICAgICAgICAgICAgIGRmX3Rlc3QgPSBkZl90ZXN0LAogICAgICAgICAgICAgIG5uX3ByZWRzID0gbm5fcHJlZHMsCiAgICAgICAgICAgbm5fYWNjdXJhY3kgPSBubl9hY2N1cmFjeSkKCiAgcmV0dXJuKG91dCkKfQoKYGBgCgoqIFNldCB0aGUgZGF0YWZyYW1lIHRvIGJlIGBiZWVyX3RvdGFsc2AsIHRoZSBwcmVkaWN0b3IgdmFyaWFibGVzIHRvIGJlIHRoZSB2ZWN0b3IgY29udGFpbmVkIGluIGBwX3ZhcnNgLCB0aGUgb3V0Y29tZSB0byBiZSBgc3R5bGVfY29sbGFwc2VkYAoKClRha2Ugb3V0IE5BcwpgYGB7ciwgZWNobz1UUlVFfQpidF9vbWl0IDwtIGJlZXJfdG90YWxzICU+JSBuYS5vbWl0KCkKYGBgCgpgYGB7ciwgZWNobz1UUlVFLCBldmFsPVRSVUUsIGVycm9yPVRSVUV9CnBfdmFycyA8LSBjKCJ0b3RhbF9ob3BzIiwgInRvdGFsX21hbHQiLCAiYWJ2IiwgImlidSIsICJzcm0iKQoKbm5fY29sbGFwc2VkX291dCA8LSBydW5fbmV1cmFsX25ldChkZiA9IGJ0X29taXQsIG91dGNvbWUgPSAic3R5bGVfY29sbGFwc2VkIiwgCiAgICAgICAgICAgICAgICAgICAgICAgICBwcmVkaWN0b3JfdmFycyA9IHBfdmFycykKCgojIEhvdyBhY2N1cmF0ZSB3YXMgaXQ/Cm5uX2NvbGxhcHNlZF9vdXQkbm5fYWNjdXJhY3kKCiMgV2hhdCB3ZXJlIHRoZSBtb3N0IGltcG9ydGFudCB2YXJpYWJsZXM/Cm5uX2NvbGxhcHNlZF9vdXQkbW9zdF9pbXBvcnRhbnRfdmFycwoKYGBgCgoKKiBXaGF0IGlmIHdlIHByZWRjaXQgYHN0eWxlYCBpbnN0ZWFkIG9mIGBzdHlsZV9jb2xsYXBzZWRgPwoKYGBge3IsIGVjaG89VFJVRSwgZXJyb3I9VFJVRX0KCm5uX25vdGNvbGxhcHNlZF9vdXQgPC0gcnVuX25ldXJhbF9uZXQoZGYgPSBidF9vbWl0LCBvdXRjb21lID0gInN0eWxlIiwgCiAgICAgICAgICAgICAgICAgICAgICAgICBwcmVkaWN0b3JfdmFycyA9IHBfdmFycykKCm5uX25vdGNvbGxhcHNlZF9vdXQkbm5fYWNjdXJhY3kKCm5uX25vdGNvbGxhcHNlZF9vdXQkbW9zdF9pbXBvcnRhbnRfdmFycwoKYGBgCgoKQW5kIG5vdyBpZiB3ZSBhZGQgYGdsYXNzYCBhcyBhIHByZWRpY3Rvcj8KYGBge3IsIGVjaG89VFJVRSwgZXJyb3I9VFJVRX0KCnBfdmFyc19hZGRfZ2xhc3MgPC0gYygidG90YWxfaG9wcyIsICJ0b3RhbF9tYWx0IiwgImFidiIsICJpYnUiLCAic3JtIiwgImdsYXNzIikKCm5uX2NvbGxhcHNlZF9vdXRfYWRkX2dsYXNzIDwtIHJ1bl9uZXVyYWxfbmV0KGRmID0gYmVlcl9pbmdyZWRpZW50c19qb2luLCBvdXRjb21lID0gInN0eWxlX2NvbGxhcHNlZCIsIAogICAgICAgICAgICAgICAgICAgICAgICAgcHJlZGljdG9yX3ZhcnMgPSBwX3ZhcnNfYWRkX2dsYXNzKQoKbm5fY29sbGFwc2VkX291dF9hZGRfZ2xhc3Mkbm5fYWNjdXJhY3kKCm5uX2NvbGxhcHNlZF9vdXRfYWRkX2dsYXNzJG1vc3RfaW1wb3J0YW50X3ZhcnMKCmBgYAoKCgoKIyMjIFJhbmRvbSBmb3Jlc3Qgd2l0aCBhbGwgaW5ncmVkaWVudHMKCiogV2UgY2FuIHVzZSBhIHJhbmRvbSBmb3Jlc3QgdG8gZ2V0IGV2ZW4gbW9yZSBncmFudWxhciB3aXRoIGluZ3JlZGllbnRzCiAgICAqIFRoZSBzcGFyc2UgaW5ncmVkaWVudCBkYXRhZnJhbWUgd2FzIHRvbyBjb21wbGV4IGZvciB0aGUgbXVsdGlub21pYWwgbmV1cmFsIG5ldCBidXQgdGhlIGByYW5nZXJgIGNhbiBoYW5kbGUgc3BhcnNlIGRhdGEgbGlrZSB0aGlzCgoqIEhlcmUgd2UgZG9uJ3QgaW5jbHVkZSBgZ2xhc3NgIGFzIGEgcHJlZGljdG9yCgpgYGB7ciwgZWNobz1UUlVFfQoKbGlicmFyeShyYW5nZXIpCmxpYnJhcnkoc3RyaW5ncikKCmJpIDwtIGJlZXJfaW5ncmVkaWVudHNfam9pbiAlPiUgCiAgc2VsZWN0KC1jKGlkLCBuYW1lLCBzdHlsZSwgaG9wc19uYW1lLCBtYWx0X25hbWUsCiAgICAgICAgICAgICMgZGVzY3JpcHRpb24sCiAgICAgICAgICAgIGdsYXNzKSkgJT4lIAogIG11dGF0ZShyb3cgPSAxOm5yb3coLikpICU+JSAKICBuYS5vbWl0KCkKCmJpJHN0eWxlX2NvbGxhcHNlZCA8LSBmYWN0b3IoYmkkc3R5bGVfY29sbGFwc2VkKQoKCiMgcmFuZ2VyIGNvbXBsYWlucyBhYm91dCBzcGVjaWFsIGNoYXJhY3RlcnMgYW5kIHNwYWNlcyBpbiBpbmdyZWRpZW50IGNvbHVtbiBuYW1lcy4gVGFrZSB0aGVtIG91dCBhbmQgcmVwbGFjZSB3aXRoIGVtcHR5IHN0cmluZy4KbmFtZXMoYmkpIDwtIHRvbG93ZXIobmFtZXMoYmkpKQpuYW1lcyhiaSkgPC0gc3RyX3JlcGxhY2VfYWxsKG5hbWVzKGJpKSwgIiAiLCAiIikKbmFtZXMoYmkpIDwtIHN0cl9yZXBsYWNlX2FsbChuYW1lcyhiaSksICIoW1xcKFxcKS1cXC8nKV0rKSIsICIiKQoKIyBLZWVwIDgwJSBmb3IgdHJhaW5pbmcKYmlfdHJhaW4gPC0gc2FtcGxlX24oYmksIG5yb3coYmkpKigwLjgpKQoKIyBUaGUgcmVzdCBpcyBmb3IgdGVzdGluZwpiaV90ZXN0IDwtIGJpICU+JQogIGZpbHRlcighIChyb3cgJWluJSBiaV90cmFpbiRyb3cpKSAlPiUKICBkcGx5cjo6c2VsZWN0KC1yb3cpCgpiaV90cmFpbiA8LSBiaV90cmFpbiAlPiUKICBkcGx5cjo6c2VsZWN0KC1yb3cpICU+JSAKICBzZWxlY3QoLWAjMDYzMDBgKQoKYmlfcmYgPC0gcmFuZ2VyKHN0eWxlX2NvbGxhcHNlZCB+IC4sIGRhdGEgPSBiaV90cmFpbiwgaW1wb3J0YW5jZSA9ICJpbXB1cml0eSIsIHNlZWQgPSAxMSkKYGBgCgoKT09CIChvdXQgb2YgYmFnKSBwcmVkaWN0aW9uIGVycm9yIGlzIGFyb3VuZCA1OCUKICAgICogVGhpcyBjYWxjdWxhdGVkIGZyb20gdHJlZSBzYW1wbGVzIGNvbnN0cnVjdGVkIGJ1dCBub3QgdXNlZCBpbiB0cmFpbmluZyBzZXQ7IHRoZXNlIHRyZWVzIGJlY29tZSBlZmZlY3RpdmVseSBwYXJ0IG9mIHRlc3Qgc2V0CmBgYHtyfQpiaV9yZgpgYGAKCgpXZSBjYW4gY29tcGFyZSBwcmVkaWN0ZWQgY2xhc3NpZmljYXRpb24gb24gdGhlIHRlc3Qgc2V0IHRvIHRoZWlyIGFjdHVhbCBzdHlsZSBjbGFzc2lmaWNhdGlvbi4KYGBge3IsIGVjaG89VFJVRX0KcHJlZF9iaV9yZiA8LSBwcmVkaWN0KGJpX3JmLCBkYXQgPSBiaV90ZXN0KQojIGthYmxlKHRhYmxlKGJpX3Rlc3Qkc3R5bGVfY29sbGFwc2VkLCBwcmVkX2JpX3JmJHByZWRpY3Rpb25zKSkKYGBgCgoKVmFyaWFibGUgaW1wb3J0YW5jZQoKKiBJbnRlcmVzdGluZ2x5LCBBQlYsIElCVSwgYW5kIFNSTSBhcmUgYWxsIG11Y2ggbW9yZSBpbXBvcnRhbnQgaW4gdGhlIHJhbmRvbSBmb3Jlc3QgdGhhbiBgdG90YWxfaG9wc2AgYW5kIGB0b3RhbF9tYWx0YApgYGB7ciwgZWNobz1UUlVFfQoKaW1wb3J0YW5jZShiaV9yZilbMToxMF0KYGBgCgoKSG93IGRvZXMgYSBDU1JGIChjYXNlLXNwZWNpZmljIHJhbmRvbSBmb3Jlc3QpIGZhcmU/CgpgYGB7ciwgZWNobz1UUlVFfQoKYmlfY3NyZiA8LSBjc3JmKHN0eWxlX2NvbGxhcHNlZCB+IC4sIHRyYWluaW5nX2RhdGEgPSBiaV90cmFpbiwgdGVzdF9kYXRhID0gYmlfdGVzdCwKICAgICAgICAgICAgICAgIHBhcmFtczEgPSBsaXN0KG51bS50cmVlcyA9IDUsIG10cnkgPSA0KSwKICAgICAgICAgICAgICAgIHBhcmFtczIgPSBsaXN0KG51bS50cmVlcyA9IDIpKQoKY3NyZl9hY2MgPC0gcG9zdFJlc2FtcGxlKGJpX2NzcmYsIGJpX3Rlc3Qkc3R5bGVfY29sbGFwc2VkKQoKY3NyZl9hY2MKYGBgCgoKCgoKIyMjIEZpbmFsIFRob3VnaHRzCgoKKlN0eWxlIGZpcnN0LCBmb3JnaXZlbmVzcyBsYXRlcj8qCgoqIE9uZSByZWFzb24gIHNlZW1zIHRoYXQgYmVlcnMgYXJlIGdlbmVyYWxseSBicmV3ZWQgd2l0aCBzdHlsZSBpbiBtaW5kIGZpcnN0ICgibGV0J3MgbWFrZSBhIHBhbGUgYWxlIikgcmF0aGVyIHRoYW4gZGVjaWRpbmcgdGhlIGJlZXIncyBzdHlsZSBhZnRlciBkZXRlcm1pbmluZyBpdHMgY2hhcmFjdGVyaXN0aWNzIGFuZCBpZGlvc3luY3Jhc2llcyAKICAgICogRXZlbiBpZiB0aGUgYmVlciB0dXJucyBvdXQgbW9yZSBsaWtlIGEgc291ciwgYW5kIGluIGEgYmxpbmQgdGFzdGUgdGVzdCBtaWdodCBiZSBjbGFzc2lmaWVkIGFzIGEgc291ciBtb3JlIG9mdGVuIHRoYW4gYSBwYWxlIGFsZSwgaXQgc3RpbGwgZ2V0cyB0aGUgbGFiZWwgcGFsZSBhbGUKICAgICogVGhpcyBtYWtlcyB0aGUgc3R5bGUgZGVmaW5pdGlvbnMgYnJvYWRlciBhbmQgaGFyZGVyIHRvIHByZWRpY3QKCgoKKkZ1dHVyZSBEaXJlY3Rpb25zKgoKKiBIaWVyYXJjaGljYWwgY2x1c3RlcmluZwoqIEluY29ycG9yYXRlIGZsYXZvciBwcm9maWxlcyBmb3IgYmVlcnMgc291cmNlZC9zY3JhcGVkIGZyb20gc29tZXdoZXJlCiogSW1wbGVtZW50IGEgR0FOIHRvIGNvbWUgdXAgd2l0aCBiZWVyIG5hbWVzCiogTW9yZSBvbiB0aGUgaG9wcyBkZWVwIGRpdmU6IHdoaWNoIGhvcHMgYXJlIHVzZWQgbW9zdCBvZnRlbiBpbiB3aGljaCBzdHlsZXM/CgoKCiFbXSguL3BvdXIuanBnKQoKCmBgYHtyLCBlY2hvPVRSVUV9CnNlc3Npb25JbmZvKCkKYGBgCgoKCg==